RAND 


EDUCATION 


THE  ARTS 

CHILD  POLICY 

CIVIL  JUSTICE 

EDUCATION 

ENERGY  AND  ENVIRONMENT 

HEALTH  AND  HEALTH  CARE 

INTERNATIONAL  AFFAIRS 

NATIONAL  SECURITY 

POPULATION  AND  AGING 

PUBLIC  SAFETY 

SCIENCE  AND  TECHNOLOGY 

SUBSTANCE  ABUSE 

TERRORISM  AND 
HOMELAND  SECURITY 

TRANSPORTATION  AND 
INFRASTRUCTURE 

WORKFORCE  AND  WORKPLACE 


This  PDF  document  was  made  available  from  www.rand.org  as 
a  public  service  of  the  RAND  Corporation. 

Tump  down  to  document  ▼ 

The  RAND  Corporation  is  a  nonprofit  research 
organization  providing  objective  analysis  and 
effective  solutions  that  address  the  challenges  facing 
the  public  and  private  sectors  around  the  world. 

Support  RAND 

Purchase  this  document 
Browse  Books  &  Publications 

Make  a  charitable  contribution 


For  More  Information 

Visit  RAND  at  www.rand.org 
Explore  RAND  Education 
View  document  details 


Limited  Electronic  Distribution  Rights 

This  document  and  trademark(s)  contained  herein  are  protected  by  law  as  indicated  in  a 
notice  appearing  later  in  this  work.  This  electronic  representation  of  RAND  intellectual 
property  is  provided  for  non-commercial  use  only.  Unauthorized  posting  of  RAND  PDFs 
to  a  non-RAND  Web  site  is  prohibited.  RAND  PDFs  are  protected  under  copyright  law. 
Permission  is  required  from  RAND  to  reproduce,  or  reuse  in  another  form,  any  of  our  research 
documents  for  commercial  use.  For  information  on  reprint  and  linking  permissions,  please 
see  RAND  Permissions. 


Report  Documentation  Page 


Form  Approved 
OMB  No.  0704-0188 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 


1.  REPORT  DATE 

2008 


2.  REPORT  TYPE 

final 


4.  TITLE  AND  SUBTITLE 

Pain  and  gain  implementing  No  Child  Left  Behind  in  three  states, 
2004-2006 

6.  AUTHOR(S) 

Brian  Stecher;  Scott  Epstein;  Laura  Hamilton;  Julie  Marsh;  Abby  Robyn 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

RAND  Corporation, 1776  Main  Street, Santa  Monica, CA, 90407 


3.  DATES  COVERED 

00-00-2008  to  00-00-2008 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

5d.  PROIECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

MG-784-NSF 


9.  SPONSORING/MONITORING  AGENCY  NAME(S )  AND  ADDRESS(ES )  10.  SPONSOR/MONITOR' S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

Online  access  http://www.rand.org/pubs/monographs/MG784/  Additional  Authors:  Personal  name: 
McCombs,  Jennifer  S.;  Personal  name:  Russell,  Jennifer  L.;  Personal  name:  Naftel,  Scott. 

14.  ABSTRACT 

The  Implementing  Standards-Based  Accountability  (ISBA)  study  was  designed  to  examine  the  strategies 
that  states,  districts,  and  schools  are  using  to  implement  standards-based  accountability  under  the  No 
Child  Left  Behind  Act  (NCLB)  and  how  these  strategies  are  associated  with  classroom  practices  and 
student  achievement  in  mathematics  and  science.  This  monograph  presents  the  final  results  of  the  ISBA 
project.  It  contains  descriptive  information  regarding  the  implementation  of  NCLB  in  California,  Georgia, 
and  Pennsylvania  from  2003-2004  through  2005-2006.  It  is  a  companion  to  MG-589-NSF,  Standards-Based 
Accountability  Under  No  Child  Left  Behind  (2007),  and  updates  those  findings  with  an  additional  year  of 
data,  permitting  further  analyses  of  state-to-state  differences  and  longer-term  trends.  This  study  suggests 
that  school  improvement  efforts  might  be  more  effective  if  they  were  responsive  to  local  conditions  and 
customized  to  address  the  specific  causes  of  failure  and  the  capacity  of  the  schools  in  question. 

15.  SUBIECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

18.  NUMBER 

19a.  NAME  OF 

ABSTRACT 

OF  PAGES 

RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Same  as 
Report  (SAR) 

168 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


This  product  is  part  of  the  RAND  Corporation  monograph  series.  RAND 
monographs  present  major  research  findings  that  address  the  challenges  facing 
the  public  and  private  sectors.  All  RAND  monographs  undergo  rigorous  peer 
review  to  ensure  high  standards  for  research  quality  and  objectivity. 


Pain  and  Gain 

Implementing  No  Child  Left  Behind 
in  Three  States,  2004-2006 


Brian  M.  Stecher,  Scott  Epstein,  Laura  S.  Hamilton, 
Julie  A.  Marsh,  Abby  Robyn,  Jennifer  Sloan  McCombs, 
Jennifer  Russell,  Scott  Naftel 


Sponsored  by  the  National  Science  Foundation 


RAND 


EDUCATION 


The  research  described  in  this  report  was  sponsored  by  the  National 
Science  Foundation  and  was  conducted  by  RAND  Education,  a  unit  of 
the  RAND  Corporation. 


Library  of  Congress  Cataloging-in-Publication  Data  is  available  for  this  publication. 
ISBN:  978-0-8330-4610-9 


The  RAND  Corporation  is  a  nonprofit  research  organization  providing 
objective  analysis  and  effective  solutions  that  address  the  challenges  facing 
the  public  and  private  sectors  around  the  world.  RAND’s  publications  do 
not  necessarily  reflect  the  opinions  of  its  research  clients  and  sponsors. 

RAND®  is  a  registered  trademark. 


©  Copyright  2008  RAND  Corporation 

All  rights  reserved.  No  part  of  this  book  may  be  reproduced  in  any 
form  by  any  electronic  or  mechanical  means  (including  photocopying, 
recording,  or  information  storage  and  retrieval)  without  permission  in 
writing  from  RAND. 

Published  2008  by  the  RAND  Corporation 
1776  Main  Street,  P.O.  Box  2138,  Santa  Monica,  CA  90407-2138 
1200  South  Hayes  Street,  Arlington,  VA  22202-5050 
4570  Fifth  Avenue,  Suite  600,  Pittsburgh,  PA  15213-2665 
RAND  URL:  http://www.rand.org 

To  order  RAND  documents  or  to  obtain  additional  information,  contact 
Distribution  Services:  Telephone:  (310)  451-7002; 

Fax:  (310)  451-6915;  Email:  order@rand.org 


Preface 


The  Implementing  Standards-Based  Accountability  (ISBA)  study  was  designed  to  exam¬ 
ine  the  strategies  that  states,  districts,  and  schools  are  using  to  implement  standards- 
based  accountability  (SBA)  under  the  No  Child  Left  Behind  Act  (NCLB)  and  how 
these  strategies  are  associated  with  classroom  practices  and  student  achievement  in 
mathematics  and  science.  This  monograph  presents  the  final  results  of  the  ISBA  proj¬ 
ect.  It  contains  descriptive  information  regarding  the  implementation  of  NCLB  in 
California,  Georgia,  and  Pennsylvania  from  2003-2004  through  2005-2006.  It  is 
a  companion  to  MG-589-NSF,  Standards-Based  Accountability  Under  No  Child  Left 
Behind  (2007),  and  updates  those  findings  with  an  additional  year  of  data,  permitting 
further  analyses  of  state-to-state  differences  and  longer-term  trends.  Like  the  compan¬ 
ion  report,  this  monograph  should  be  of  particular  interest  to  educators  and  policy¬ 
makers  in  California,  Georgia,  and  Pennsylvania,  and  of  general  interest  to  those  con¬ 
cerned  with  standards-based  reforms  and  NCLB. 

This  study  suggests  that  school  improvement  efforts  might  be  more  effective  if 
they  were  responsive  to  local  conditions  and  customized  to  address  the  specific  causes 
of  failure  and  the  capacity  of  the  school  in  question. 

This  research  was  conducted  by  RAND  Education,  a  unit  of  the  RAND  Cor¬ 
poration.  It  is  part  of  a  larger  body  of  work  addressing  accountability  in  state  and  fed¬ 
eral  education.  The  project  was  sponsored  by  the  National  Science  Foundation.  Any 
opinions,  findings,  conclusions,  or  recommendations  expressed  in  this  monograph  are 
those  of  the  authors  and  do  not  necessarily  reflect  the  views  of  the  National  Science 
Foundation. 
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Summary 


NCLB,  perhaps  the  most  significant  federal  policy  relating  to  K-12  public  education, 
requires  each  state  to  create  a  standards-based  accountability  system  that  includes  three 
components:  (1)  academic  standards,  (2)  assessments  to  measure  student  mastery  of  the 
standards,  and  (3)  consequences  to  encourage  improved  performance.  NCLB  makes 
significant  demands  on  states,  districts,  and  schools.  However,  the  law  also  gives  educa¬ 
tors  a  great  deal  of  flexibility  in  how  they  reach  NCLB  goals.  The  success  of  NCLB  is 
therefore  partially  dependent  on  how  districts  and  schools  implement  the  law  and  what 
policies  and  strategies  these  entities  rely  on  to  improve  student  achievement. 

The  ISBA  study  was  designed  to  examine  what  strategies  states,  districts,  and 
schools  are  using  to  implement  SBA  and  how  these  strategies  are  associated  with  class¬ 
room  practices  and  student  achievement  in  mathematics  and  science.  The  ISBA  study 
was  structured  as  a  set  of  three  state-specific  case  studies;  we  collected  longitudinal 
data  from  California,  Georgia,  and  Pennsylvania  each  year  for  three  years  from  the 
2003-2004  school  year  through  the  2005-2006  school  year.  This  monograph  is  an 
update  of  Standards-Based  Accountability  Under  No  Child  Left  Behind  (Hamilton  et  ah, 
2007),  which  was  based  on  data  from  the  2003-2004  and  2004-2005  school  years  of 
data  collection. 

The  companion  monograph  contained  detailed  information  about  the  atti¬ 
tudes  and  actions  of  superintendents,  principals,  and  teachers  in  each  of  the  states, 
and  it  drew  a  number  of  general  conclusions.  In  that  monograph,  we  found  that  the 
accountability  systems  enacted  in  response  to  NCLB  differed  in  important  ways  across 
the  three  states,  including  the  content  of  their  academic  standards,  the  difficulty  of 
their  performance  standards,  and  their  systems  for  support  and  technical  assistance. 
Despite  these  differences,  districts  and  schools  responded  to  the  accountability  sys¬ 
tems  in  broadly  similar  ways.  For  example,  principals  reported  similar  school  improve¬ 
ment  efforts  focusing  on  aligning  standards,  curriculum,  and  assessments;  providing 
extra  instruction  to  low-performing  students;  and  using  test  results  for  instructional 
planning.  Teachers  enacted  these  initiatives  in  their  classrooms  and  generally  felt  the 
changes  benefited  students.  However,  teachers  also  reported  narrowing  the  curriculum 
toward  tested  topics  and  focusing  on  students  near  the  proficient  cutoff  score,  and  some 
complained  of  lowered  morale  among  their  peers  and  lack  of  alignment  between  tested 
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goals  and  their  local  curriculum  materials.  Administrators  were  generally  more  posi¬ 
tive  toward  the  reform  than  teachers,  but  both  identified  similar  factors  that  hindered 
their  efforts  to  improve  student  performance.  These  hindrances  included  inadequate 
resources  and  lack  of  instructional  time,  but  they  also  included  students’  lack  of  basic 
skills  and  inadequate  support  from  parents.  We  recommended  strengthened  efforts 
to  align  system  components,  development  of  teacher  and  administrator  capacities  for 
improvement,  and  the  development  of  better  methods  for  measuring  school  and  stu¬ 
dent  performance. 

For  the  most  part,  those  findings  and  recommendations  still  hold.  However,  the 
additional  year  of  data  collected  in  2006  enabled  us  to  refine  the  analyses,  particularly 
examining  more  carefully  state-to-state  variations  and  multiyear  trends.  In  this  mono¬ 
graph,  we  draw  upon  superintendent,  principal,  and  teacher  survey  data  from  all  three 
years  of  our  data  collection  to  explore  the  further  development  of  policies  and  practices 
in  each  of  the  three  states.  For  each  state,  we  address  the  following  four  basic  research 
questions: 

1.  How  did  districts,  schools,  and  teachers  respond  to  state  accountability  efforts, 
including  state  standards  and  state  tests? 

2.  What  school  improvement  strategies  were  used  and  which  were  perceived  to  be 
most  useful? 

3.  What  was  the  impact  of  accountability  on  curriculum,  teacher  practice,  and 
student  learning? 

4.  What  conditions  hindered  district,  school,  and  teacher  improvement  efforts? 


Study  Methods 

We  chose  California,  Georgia,  and  Pennsylvania  because  of  their  diversity  in  terms 
of  geography,  demography,  and  their  approaches  to  implementing  NCLB.  The  study 
used  a  combination  of  large-scale,  quantitative  data  collection  and  small-scale  case 
study  methods  to  examine  NCLB  implementation  at  the  state,  district,  school,  and 
classroom  levels.  At  the  state  level,  we  conducted  interviews  with  key  stakeholders 
and  collected  relevant  documents.  District-level  data  were  collected  from  superinten¬ 
dents  through  paper-and-pencil  surveys  in  each  year  and  through  semistructured  tele¬ 
phone  interviews  in  the  first  and  third  years.  School-level  data  were  gathered  each  year 
through  principal  and  teacher  surveys  and  through  annual  case  studies  in  a  small  sub- 
sample  of  schools. 

We  selected  a  random  sample  of  districts  stratified  by  size,  and  we  randomly 
selected  “regular”  elementary  and  middle  schools  (excluding  charter  schools,  alterna¬ 
tive  schools,  and  the  like)  from  the  districts  that  agreed  to  cooperate.  In  participating 
elementary  schools,  we  administered  surveys  to  all  teachers  who  taught  math  and  sci- 
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ence  in  grades  three,  four,  and  five,  and  in  participating  middle  schools,  we  adminis¬ 
tered  surveys  to  all  teachers  who  taught  these  subjects  in  grades  seven  and  eight. 

Response  rates  were  quite  high  for  each  of  the  three  surveys  (superintendent,  prin¬ 
cipal,  and  teacher)  each  year  (see  Tables  A.5  and  A. 6).  To  analyze  survey  responses,  we 
generated  sampling  and  nonresponse  weights  for  each  state.  Using  these  weights,  we 
are  able  to  report  statewide  estimates  of  the  responses  of  superintendents,  principals, 
and  teachers  from  regular  public  schools  and  districts. 


Findings 

We  structured  the  ISBA  study  as  a  set  of  three  parallel  case  studies  in  different  contexts, 
and  we  found  that  state  context  affected  the  implementation  of  NCLB.  As  a  result,  we 
report  findings  in  separate  chapters  for  each  state.  Nevertheless,  there  were  some  common 
themes  across  the  three  states,  and  these  findings  are  largely  consistent  with  large-scale 
studies  of  the  implementation  of  NCLB  (U.S.  Department  of  Education,  2007a  and 
2007b;  Center  on  Education  Policy  [CEP],  2006,  2007a,  2007b,  and  2008). 

Common  Themes  Across  States 

By  the  end  of  this  study,  all  three  states  had  constructed  most  of  the  infrastructure 
needed  to  support  standards-based  accountability  (standards,  assessments,  reporting 
structures),  and  most  educators  understood  the  reforms.  At  all  levels  of  the  education 
hierarchy,  alignment  among  standards,  assessments,  and  curriculum  was  a  major  focus 
of  NCLB  implementation.  However,  despite  these  efforts,  there  were  still  concerns 
about  misalignment,  especially  among  teachers. 

Educators  generally  reported  that  they  found  test  data  useful  for  teaching,  par¬ 
ticularly  data  from  progress  tests  that  were  an  increasingly  widespread  tool  in  the  three 
states.1  Educators  reported  a  variety  of  positive  effects  of  accountability,  including 
improvements  in  academic  rigor,  instruction,  and  focus  on  student  learning.  Adminis¬ 
trators  were  generally  more  positive  about  the  effects  of  NCLB  than  teachers.  Despite 
the  fact  that  many  teachers  reported  that  accountability  had  improved  learning,  they 
were  more  likely  to  question  the  validity  of  state  test  results,  and  a  majority  of  teachers 
did  not  believe  the  system  was  beneficial  for  students.  Teachers  were  concerned  with 
many  aspects  of  NCLB.  Some  teachers  were  worried  that  the  standards  were  too  dif¬ 
ficult  for  certain  students,  and  at  the  same  time  some  teachers  were  concerned  that  the 
curriculum  was  not  challenging  enough  for  high- achieving  students. 

Districts  and  schools  engaged  in  a  wide  variety  of  reforms,  including  improv¬ 
ing  alignment  of  curriculum  and  instruction  to  standards  and  assessments,  using  data 


1  Progress  tests  are  formal  assessments  given  periodically  during  the  year  to  measure  student  progress  in  master¬ 
ing  state  standards.  They  are  also  called  interim  tests,  formative  tests,  and  benchmark  tests.  To  our  knowledge, 
the  outcomes  of  these  exams  do  not  result  in  any  consequences  for  teachers  in  the  districts  we  studied. 
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to  improve  instruction,  and  focusing  on  low-performing  students.  Some  changes  in 
practice,  such  as  the  adoption  of  progress  tests,  have  occurred  more  rapidly  or  more 
completely  in  elementary  schools  than  in  middle  schools.  As  expected,  given  NCLB’s 
focus  on  math  and  reading,  far  more  effort  has  been  made  to  implement  standards- 
based  accountability  in  mathematics  than  in  science.  Many  administrators  indicated 
that  their  efforts  to  improve  school  performance  were  hindered  by  lack  of  funding  and 
lack  of  time.  Many  teachers  said  their  efforts  to  improve  student  performance  were  hin¬ 
dered  by  lack  of  time,  large  and  heterogeneous  classes,  and  poor  student  preparation. 


Trends 

Over  the  three  years,  each  of  the  states  made  progress  ironing  out  the  kinks  in  its 
accountability  systems.  For  example,  test  results  were  provided  more  quickly  or  in  more 
diverse  ways.  Also,  during  this  time  period,  educators’  responses  about  the  effects  of 
NCLB  became  more  positive;  greater  proportions  of  educators  reported  that  account¬ 
ability  had  improved  academic  rigor  and  focus  on  student  learning.  Concerns  about 
the  effects  of  NCLB  on  teacher  morale  continued,  but  the  prevalence  of  these  concerns 
decreased  over  time. 


State-Specific  Findings 

Generally,  educators  in  Georgia  reported  more-positive  attitudes  toward  SBA  than 
educators  in  California  and  Pennsylvania.  This  difference  could  be  due  to  lower  pro¬ 
ficiency  standards  in  the  state  that  make  it  easier  for  students  to  reach  proficiency  and 
for  schools  to  make  AYP  and  avoid  NCLB  interventions,  better  implementation,  or 
other  state  contextual  factors,  such  as  the  lack  of  a  strong  union  presence  in  Georgia. 
Pennsylvania  educators  generally  had  more  negative  attitudes  toward  SBA,  perhaps 
because  of  the  state’s  long  tradition  of  local  control  over  schools,  or  perhaps  because 
of  more-limited  capacity  on  the  part  of  the  Pennsylvania  Department  of  Education  to 
offer  support  and  assistance. 


The  Future  of  NCLB 

This  study  suggests  that  NCLB  has  led  to  distinctive  accountability  systems  in  each 
state — different  standards,  different  assessments,  different  support  and  assistance  strat¬ 
egies — although  each  was  derived  from  the  same  federal  legislation  and  has  the  same 
set  of  consequences.  The  reauthorization  of  the  Elementary  and  Secondary  Education 
Act  should  recognize  that  this  variation  exists  and  develop  policies  accordingly.  In 


Summary  xix 


some  cases,  new  regulations  may  be  needed  to  reduce  or  eliminate  differences — e.g.,  to 
make  proficiency  in  reading  and  mathematics  similar  across  states.  This  study  found 
a  number  of  attitudes  and  behaviors  associated  with  the  overall  level  of  student  pro¬ 
ficiency  in  the  states.  In  other  cases,  it  may  be  appropriate  to  relax  rules  to  give  states 
additional  flexibility.  This  study  suggests  that  school  improvement  efforts  might  be 
more  effective  if  they  were  responsive  to  local  conditions.  Rather  than  imposing  a  fixed 
set  of  choices  that  apply  when  schools  fail  to  achieve  AYP  for  a  given  number  of  years, 
improvement  efforts  should  be  customized  to  address  the  specific  causes  of  the  failure 
and  the  capacity  that  exists  locally. 

There  is  also  a  lesson  for  SBA  in  general.  Educators  have  become  comfortable  with 
the  underlying  SBA  theory  of  action — set  clear  goals,  develop  measures,  and  establish 
consequences  to  encourage  educators  to  achieve  them.  They  are  not  comfortable  when 
the  implementation  of  that  theory  seems  inconsistent  with  their  local  situation — e.g., 
when  the  standards  do  not  match  their  local  curriculum,  when  the  proficient  level 
seems  unattainable  for  many  of  their  students,  or  when  their  school  is  judged  against 
targets  that  feel  unattainable.  It  would  seem  that  engaging  educators  in  the  develop¬ 
ment  or  refinement  of  the  SBA  framework  (e.g.,  the  reauthorization  of  NCLB)  would 
be  a  good  way  to  attempt  to  bridge  this  gap. 
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CHAPTER  ONE 


Introduction  and  Methods 


The  No  Child  Left  Behind  (NCLB)  Act  of  2001  (20  U.S.C.  §  6311  et  seq.)  is  currently 
the  preeminent  federal  policy  relating  to  K— 12  public  education,  and  at  its  center  are 
its  standards-based  accountability  (SBA)  provisions.  NCLB  requires  that  each  state 
create  an  SBA  system  that  includes  three  main  components:  (1)  academic  standards, 
(2)  assessments  to  measure  student  mastery  of  the  standards,  and  (3)  incentives  to 
improve  performance.  In  the  case  of  NCLB,  the  incentives  take  the  form  of  a  series 
of  interventions  and  sanctions  for  schools  and  districts  whose  students  fail  to  demon¬ 
strate  mastery  on  the  assessments.  The  Implementing  Standards-Based  Accountability 
(ISBA)  study  was  designed  to  examine  what  strategies  states,  districts,  and  schools  are 
using  to  implement  SBA  under  NCLB  and  how  these  strategies  are  associated  with 
classroom  practice  and  student  achievement  in  mathematics  and  science.  The  ISBA 
study  was  designed  as  a  set  of  three  state-specific  case  studies;  we  collected  data  from 
California,  Georgia,  and  Pennsylvania  longitudinally  from  the  2003-2004  school  year 
through  the  2005-2006  school  year. 

This  monograph  is  an  update  of  Standards-Based  Accountability  Under  No  Child 
Left  Behind  (Hamilton  et  ah,  2007),  which  reported  on  data  from  the  2003-2004  and 
2004-2005  years  of  data  collection.  The  companion  monograph  presented  descriptive 
results  relating  to  educators’  attitudes  toward  SBA,  district  and  school  improvement 
strategies,  changes  in  classroom  practices,  and  perceived  barriers  to  improvement. 


Findings  from  the  Previous  Monograph 

•  State  accountability  systems  enacted  in  response  to  NCLB  differed  across  the  three 
states. 

The  three  state  systems  differed  with  respect  to  the  content  of  the  academic  stan¬ 
dards,  the  difficulty  level  of  their  performance  standards,  their  choice  of  addi¬ 
tional  indicators,  and  their  school  and  district  support  and  technical  assistance 
mechanisms,  just  to  name  a  few  areas.  Many  of  the  differences  were  related  to 


1 


2  Pain  and  Gain:  Implementing  No  Child  Left  Behind  in  Three  States,  2004-2006 


pre-NCLB  contextual  factors,  including  the  degree  to  which  the  state  had  already 
been  engaged  in  SBA  efforts  prior  to  NCLB. 

•  Districts  and  schools  responded  to  the  new  state  accountability  systems  actively  and  in 
broadly  similar  ways,  despite  state  differences. 

In  all  three  states,  majorities  of  school  and  district  administrators  described  simi¬ 
lar  types  of  school-improvement  activities,  including  aligning  curricula  with  stan¬ 
dards,  providing  technical  assistance  to  help  schools  improve,  and  offering  a  vari¬ 
ety  of  professional  development  (PD)  opportunities  for  principals  and  teachers. 
Principals  reported  providing  extra  learning  opportunities  for  low-performing 
students,  promoting  the  use  of  student  test  results  for  instructional  planning, 
implementing  test  preparation  activities,  and  adopting  interim  or  progress  tests  to 
provide  more  frequent  assessment  information.  Georgia  districts  and  schools  were 
especially  active  in  promoting  science  instruction  and  in  adopting  interim  assess¬ 
ment  systems  compared  with  districts  or  schools  in  California  and  Pennsylvania. 

•  Reported  changes  at  the  classroom  level  included  both  desirable  and  undesirable 
responses. 

On  the  positive  side,  teachers  reported  efforts  to  align  instruction  with  standards 
and  efforts  to  improve  their  own  practices.  On  the  negative  side,  teachers  reported 
narrowing  of  curriculum  and  instruction  toward  tested  topics  and  even  toward 
certain  problem  styles  or  formats  and  focusing  more  on  students  near  the  profi¬ 
cient  cutoff  score  (i.e.,  bubble  kids),  which,  they  said,  might  have  negative  effects 
on  the  learning  opportunities  given  to  high-achieving  students. 

•  Educators  expressed  support  for  NCLB  goals  but  had  concerns  about  specific  features 
and  effects. 

For  instance,  most  administrators  thought  that  state  test  scores  accurately  reflected 
student  achievement,  a  sentiment  that  only  a  small  minority  of  teachers  shared. 
Teachers  were  particularly  attuned  to  lack  of  consistency  between  state  account¬ 
ability  requirements  and  local  resources  and  programs.  Teachers  associated  the 
implementation  of  SBA  with  reduced  morale  and  expressed  concerns  about  nega¬ 
tive  effects  on  their  teaching. 

•  Several  perceived  hindrances  may  stand  in  the  way  of  effective  implementation  of 
NCLB. 

Most  administrators  thought  that  inadequate  funding  was  hampering  their 
school-improvement  efforts,  and  many  said  that  they  did  not  have  adequate  num¬ 
bers  of  highly  qualified  teachers  in  mathematics  or  science.  Administrators  and 
teachers  alike  saw  insufficient  instructional  time  and  insufficient  planning  time 
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as  barriers.  In  addition,  teachers  reported  that  students’  lack  of  basic  skills,  inad¬ 
equate  support  from  parents,  and  student  absenteeism  and  tardiness  hampered 
their  efforts. 

We  drew  four  implications  from  these  results:  (1)  alignment  efforts  at  all  levels 
need  to  be  improved,  (2)  teacher  and  administrator  capacity  for  school  improvement 
needs  to  be  enhanced,  (3)  better  measures  of  school  and  student  performance  need 
to  be  developed,  and  (4)  teacher  concerns  about  negative  consequences  need  to  be 
addressed.  Despite  substantial  state-to-state  differences  in  the  specific  features  of  each 
accountability  system,  it  appears  that  NCLB’s  single-minded  emphasis  on  student  pro¬ 
ficiency  on  tests  has  both  heightened  schools’  focus  on  outcomes  and  led  to  potentially 
negative  consequences.  One  of  the  key  challenges  facing  educators  is  to  identify  ways 
to  increase  the  prevalence  of  desirable  responses  and  minimize  the  undesirable  ones, 
given  the  context  in  which  educators  are  working. 


The  Current  Study 

This  monograph  builds  on  the  companion  document  by  presenting  results  from 
all  three  years  of  the  ISBA  study  and  examining  trends  across  time  in  each  of  the  states. 
Presenting  results  separately  by  state  allows  us  to  focus  on  the  unique  experience  of 
each  state  in  implementing  SBA  over  the  three-year  period.  Cross-state  comparisons 
can  also  be  illuminating;  thus,  we  report  on  important  differences  among  the  states 
within  the  state-specific  sections.  For  each  state,  we  address  the  following  four  basic 
research  questions: 

1.  How  did  districts,  schools,  and  teachers  respond  to  state  accountability  efforts, 
including  state  standards  and  state  tests? 

2.  What  school  improvement  strategies  were  used  and  which  were  perceived  to  be 
most  useful? 

3.  What  was  the  impact  of  accountability  on  curriculum,  teacher  practice,  and 
student  learning? 

4.  What  conditions  hindered  district,  school,  and  teacher  improvement  efforts? 

In  most  cases,  responses  within  a  state  were  consistent  across  the  three  years, 
although  there  are  important  examples  of  areas  where  responses  evolved  over  time, 
which  we  highlight.  We  also  considered  how  responses  varied  across  school  level  (ele¬ 
mentary  school  versus  middle  school),  subject  (mathematics  versus  science),  and  the 
administrative  hierarchy  (teachers,  principals,  and  superintendents). 
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Overview  of  Standards-Based  Accountability  Under  No  Child  Left 
Behind 

In  theory,  the  three  components  of  SBA  (standards,  assessments,  and  consequences) 
form  a  coherent  system  that  focuses  on  improving  student  achievement.  Standards 
describe  what  content  students  should  be  learning  and  the  level  of  mastery  students 
should  be  able  to  demonstrate.  In  addition,  the  standards  are  expected  to  serve  both  as 
a  basis  for  the  creation  of  assessments  and  as  a  guide  for  educators’  curriculum  develop¬ 
ment  and  instruction.  The  assessments  measure  how  well  students  have  mastered  the 
skills  and  knowledge  contained  in  the  standards,  and  aggregate  test  scores  serve  as  an 
indicator  of  schools’  success  in  making  sure  children  learn.  Consequences  for  schools 
might  include  rewards  for  those  whose  students  perform  well  and  assistance  and/or 
sanctions  for  those  whose  students  do  not.  Essentially,  the  system  creates  a  feedback 
loop  that  is  intended  to  give  educators  the  data  and  incentives  necessary  to  improve 
educational  practice  and  consequently  increase  student  achievement. 

SBA  systems  can  be  structured  in  many  different  ways.  Under  NCLB,  for  exam¬ 
ple,  the  incentives  structure  is  multifaceted.  Schools  that  do  not  meet  performance 
expectations  are  first  given  extra  support  in  the  form  of  improvement  planning  and 
PD,  and  only  later  are  sanctions  applied.1  In  addition,  students  within  those  schools  are 
given  options  to  receive  supplemental  tutoring  or  to  transfer  to  another  school.  These 
options,  while  potentially  beneficial  to  individual  students,  also  act  as  indirect  incen¬ 
tives  to  schools  and  districts  because  of  their  effects  on  how  funds  must  be  allocated. 
NCLB  requires  each  state  to  create  an  SBA  system  with  seven  basic  components: 

•  Academic  content  standards  in  reading,  mathematics,  and  science  indicate  what 
students  should  know  and  be  able  to  do. 

•  Annual  assessments  are  aligned  with  the  academic  content  standards  in  reading 
and  mathematics  in  grades  three  through  eight  and  once  in  high  school  and, 
in  science,  once  in  elementary  school,  once  in  middle  school,  and  once  in  high 
school. 

•  Achievement  standards  for  reading,  mathematics,  and  science  indicate  the  level  of 
test  performance  that  corresponds  to  “proficient”  and  other  levels  of  performance 
(sometimes  called  performance  standards). 

•  Annual  measurable  objectives  (AMOs)  in  reading  and  mathematics  indicate 
the  percentage  of  students  who  are  expected  to  be  proficient  each  year,  which 
increases  annually  until  all  students  reach  proficiency  in  2014.  AMOs  are  applied 
to  all  students  (i.e.,  to  the  school  and  to  the  district  as  a  whole)  and  to  designated 
subgroups,  including  students  from  major  racial  and  ethnic  groups,  low-income 


1  A  more  complete  explanation  of  the  stages  of  interventions  can  be  found  in  U.S.  Department  of  Education 
(2007b). 
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students,  students  with  limited  English  proficiency  (LEP),  and  students  with  dis¬ 
abilities  (if  each  group  is  of  sufficient  size).2 

•  There  is  an  additional  academic  indicator  chosen  by  the  state.  (For  high  schools, 
this  indicator  must  be  the  graduation  rate,  but  each  state  can  select  its  own  indi¬ 
cators  for  other  levels.) 

•  Adequate  yearly  progress  (AYP)  calculations  for  schools  and  districts  indicate 
whether  all  students  and  all  significant  subgroups  of  students  have  reached  AMOs 
in  reading  and  mathematics  and  whether  the  school  made  progress  on  the  addi¬ 
tional  academic  indicator  (a  school  or  district  makes  AYP  only  if  it  meets  all  the 
requirements  for  all  subgroups). 

•  There  are  interventions  and  sanctions  for  Title  I3  schools  and  districts  that  do  not 
make  AYP  for  two  or  more  years.  After  two  years,  the  mandatory  interventions 
include  formal  planning  for  improvement,  PD,  and  the  requirement  that  schools 
offer  parents  the  opportunity  to  transfer  their  child  to  a  school  that  is  not  low 
performing  (with  transportation  provided).  After  three  consecutive  years  of  not 
making  AYP,  schools  must  also  offer  students  supplemental  educational  services 
(i.e.,  tutoring).  The  interventions  escalate  in  subsequent  years  to  staffing  changes 
and  major  governance  changes,  such  as  state  takeover  or  reconstitution  as  a  char¬ 
ter  school. 

As  the  above  list  demonstrates,  NCLB  makes  significant  demands  on  states,  dis¬ 
tricts,  and  schools.  However,  the  law  also  gives  educators  a  great  deal  of  flexibility  in 
how  they  reach  NCLB  goals.  Each  state  designs  its  own  content  standards,  assess¬ 
ments,  and  performance  standards.  Although  all  students  are  expected  to  be  proficient 
by  2014,  states  decide  the  interim  targets.  Perhaps  most  significantly,  other  than  dictat¬ 
ing  certain  interventions  for  failing  schools,  NCLB  does  not  tell  schools  how  to  make 
the  achievement  gains  that  are  needed  to  meet  escalating  performance  targets  nor  what 
their  policies  should  be  for  subjects  that  are  not  included  in  the  accountability  compu¬ 
tations,  such  as  social  studies,  science,  art,  or  music.  The  success  of  NCLB  is  therefore 
largely  dependent  on  how  districts  and  schools  implement  the  law  and  what  policies 
and  strategies  these  entities  rely  on  to  improve  student  achievement. 


2  The  science  test  results  must  be  made  public,  but  there  are  no  annual  measurable  objectives  for  science,  and 
science  performance  does  count  in  calculating  a  school’s  adequate  yearly  progress,  which  is  described  below. 

3  Title  I  is  the  first  section  of  the  Elementary  and  Secondary  Education  Act  (ESEA),  which  NCLB  reauthorized. 
Title  I  provides  federal  funds  to  schools  providing  education  to  low-income  students. 
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Study  Approach  and  Methods 

Sampling 

The  three  states  we  chose  to  study  were  selected  to  provide  diversity  in  terms  of  geog¬ 
raphy,  demography,  and  their  approaches  to  implementing  NCLB  (see  Tables  A.l  and 
A.2).  California  is  the  largest  of  the  states  with  over  6.4  million  students  in  2005-2006 
and  has  the  most  diverse  student  population.  It  is  the  only  state  of  the  three  with  a  large 
population  of  English  language  learners  (about  one-quarter  of  the  student  population 
in  2005-2006)  and  has  much  larger  populations  of  Hispanic  and  Asian  students  than 
the  other  states  (47  percent  and  11  percent  of  the  student  population,  respectively). 
Georgia  has  the  largest  proportion  of  African  American  students  (38  percent  in  2005- 
2006).  Pennsylvania  is  the  least  diverse  of  the  states  and  has  the  lowest  percentage  of 
economically  disadvantaged  students;  less  than  a  third  of  Pennsylvania  students  were 
eligible  for  free  or  reduced-price  lunches  in  2005-2006,  as  compared  with  about  half 
of  students  in  California  and  Georgia.  Of  the  three  states,  California  had  the  most 
complete  SBA  system  prior  to  the  enactment  of  NCLB.  Georgia  had  just  started  to 
implement  an  SBA  system  when  NCLB  was  enacted  and  therefore  had  the  smoothest 
transition  to  NCLB  compliance.  Pennsylvania  had  a  strong  tradition  of  local  control 
and,  therefore,  had  to  work  more  quickly  than  the  other  states  to  develop  the  stan¬ 
dards,  assessments,  and  accountability  polices  that  NCLB  requires. 

In  the  first  year  of  our  data  collection  (2003-2004),  we  selected  an  initial  sample 
of  27  districts  in  each  state.  Districts  in  each  state  were  stratified  based  on  the  number 
of  elementary  and  middle  schools,  and  a  random  sample  was  drawn  within  each  stra¬ 
tum.  We  were  not  able  to  recruit  as  many  districts  as  we  had  hoped  for  and,  therefore, 
drew  a  supplemental  sample  of  23  districts.  The  total  sample  for  the  first  year  was  104 
districts,  68  of  which  agreed  to  participate  in  the  study,  representing  a  cooperation 
rate  of  65  percent.  In  2004-2005,  we  selected  an  additional  supplemental  sample  of 
28  districts  in  order  to  yield  greater  analytic  power  and  to  increase  the  number  of  dis¬ 
tricts  with  high  percentages  of  schools  struggling  to  meet  NCLB  requirements.  This 
increased  the  total  sample  to  132  districts,  92  of  which  agreed  to  participate  in  the 
2004-2005  year  of  the  study.  All  92  of  these  districts  agreed  to  continue  with  the 
study  for  the  2005-2006  year  of  data  collection  (see  Table  A.3). 

The  school  sample  was  restricted  to  include  only  “regular”  public  schools;  char¬ 
ter  schools,  alternative  schools,  vocational  schools,  special  education  schools,  and 
small  schools  were  all  excluded.  In  2003-2004,  297  schools  were  randomly  selected 
from  the  cooperating  districts.  The  number  of  schools  sampled  in  each  district  was 
based  on  district  size  and  ranged  from  one  to  five  elementary  schools,  and  one  to  five 
middle  schools.  Of  these  schools,  267  agreed  to  participate  in  2003-2004,  represent¬ 
ing  a  cooperation  rate  of  90  percent.  The  participating  schools  were  contacted  again 
in  2004-2005,  as  well  as  additional  schools  from  the  supplemental  sample  of  districts. 
The  total  sample  for  2004-2005  was  353  schools,  301  of  which  participated,  repre- 
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senting  a  cooperation  rate  of  85  percent.  In  2005-2006,  two  schools  in  Pennsylvania 
dropped  out  of  the  study,  decreasing  the  cooperation  rate  by  approximately  0.5  percent 
(see  Table  A.4).  Most  of  the  schools  in  the  sample  made  AYP  each  year  of  the  study, 
but  the  rates  were  different  across  the  states.  For  example,  in  2006,  61  percent  of 
the  sampled  schools  in  California,  76  percent  of  the  sampled  schools  in  Georgia,  and 
83  percent  of  the  sampled  schools  in  Pennsylvania  made  AYP,  according  to  principal 
reports.  Principals  also  reported  that  only  a  small  fraction  of  the  schools  in  the  sample 
were  identified  for  improvement:  15,  23,  and  10  percent,  respectively,  in  California, 
Georgia,  and  Pennsylvania. 

Each  year,  we  asked  cooperating  elementary  schools  for  a  roster  of  teachers  who 
taught  math  and  science  in  grades  three,  four,  and  five,  and  we  asked  middle  schools 
for  a  roster  of  teachers  who  taught  these  subjects  in  grades  seven  and  eight.  We  admin¬ 
istered  surveys  to  all  of  those  teachers.  Each  annual  teacher  sample  was  drawn  inde¬ 
pendently;  we  did  not  track  teachers  over  time.  Over  3,000  teachers  were  surveyed 
each  year. 

Data  Collection 

At  the  state  level,  we  conducted  semistructured  face-to-face  interviews  with  a  variety 
of  key  stakeholders,  including  high-level  state  department  of  education  officials,  leg¬ 
islators  and  legislative  staff,  state  board  of  education  staff,  and  union  and  state  school 
boards’  association  leaders.  We  also  collected  relevant  documents,  such  as  copies  of 
state  content  standards.  Most  of  the  state-level  data  collection  occurred  in  the  fall  of 
2003. 

District-level  data  were  collected  from  superintendents  through  paper-and-pencil 
surveys  in  January  and  February  of 2004,  2005,  and  2006,  and  through  semistructured 
telephone  interviews  in  the  spring  of  2004  and  2006.  School-level  data  were  gathered 
each  year  through  principal  and  teacher  surveys,  and  annual  case  studies  were  con¬ 
ducted  in  a  small  subsample  of  schools.  Many  of  the  survey  questions  appeared  in  both 
the  principal  and  teacher  surveys,  allowing  us  to  compare  responses  between  these 
groups.  Principal  and  teacher  surveys  were  distributed  in  January  and  February  of  each 
year,  and  responses  were  collected  through  June.  Each  survey  instrument  (superinten¬ 
dent,  principal,  and  teacher)  was  pilot  tested  with  representatives  from  the  appropriate 
respondent  group  using  structured  “think  aloud”  cognitive  interviews. 

Response  rates  were  quite  high  for  each  of  the  three  surveys  each  year.  The  survey 
response  rate  for  the  superintendent  survey  was  88  percent  in  2003-2004  and  73  per¬ 
cent  in  2004-2005  and  2005-2006.  The  response  rate  for  the  principal  survey  was 
between  85  and  87  percent  each  year.  The  response  rate  for  the  teacher  survey  was  83 
percent  in  2003-2004,  87  percent  in  2004-2005,  and  82  percent  in  2005-2006  (see 
Tables  A.5,  and  A.6). 
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We  also  conducted  annual  case  study  visits  to  two  elementary  schools  and  one 
middle  school  in  two  districts  in  each  state.  We  interviewed  principals,  teachers,  and 
other  staff,  and  conducted  parent  focus  groups  when  principals  agreed. 

Survey  Analyses 

To  analyze  survey  responses,  we  generated  state-specific  sampling  and  nonresponse 
weights  for  each  state.  Using  these  weights,  we  are  able  to  report  statewide  estimates  of 
the  responses  of  superintendents,  principals,  and  teachers  from  regular  public  schools 
and  districts.  Because  we  excluded  some  schools  that  are  subject  to  NCLB  require¬ 
ments  but  that  operate  outside  a  traditional  district  governance  structure,  such  as  char¬ 
ter  schools,  all  of  the  results  generalize  only  to  regular  public  schools  in  the  respec¬ 
tive  states.  One  of  the  consequences  of  our  sampling  strategy  in  which  teachers  and 
principals  are  nested  within  schools  and  schools  are  nested  within  districts  is  that  the 
number  of  responses  grows  progressively  smaller  as  we  move  from  teachers  to  princi¬ 
pals  to  superintendents.  As  a  result,  the  summary  statistics  based  on  teacher  responses 
are  more  precise  than  those  based  on  principal  responses,  which  are  more  precise  than 
those  based  on  superintendent  responses.  To  help  the  reader  interpret  the  results,  we 
include  estimates  of  the  standard  errors  (SEs)  associated  with  the  survey  responses  in 
all  of  the  tables  in  the  monograph. 


How  This  Report  Is  Organized 

Chapters  Two,  Three,  and  Four  present  results  for  California,  Georgia,  and  Pennsylva¬ 
nia,  respectively.  In  each  case,  we  first  provide  the  context  in  which  SBA  policies  have 
been  implemented  and  then  present  results  by  answering  the  four  research  questions 
listed  above.  In  each  of  these  state-specific  chapters,  we  make  comparisons  with  the 
other  states  when  the  results  were  significantly  different.  If  one  state  was  different  from 
the  other  two,  we  note  that  in  the  chapter  dedicated  to  the  first  state.  Many  of  the  End¬ 
ings  are  similar  across  the  states,  and  we  ask  readers  to  be  patient  if  the  results  seem 
familiar;  the  value  of  this  approach  is  our  ability  to  describe  the  Endings  for  each  state 
holistically  in  the  context  of  that  state’s  local  conditions  and  past  experience  with  account¬ 
ability.  Following  the  results,  we  present  conclusions  in  Chapter  Five.  Information  about 
sampling  is  contained  in  Appendix  A,  and  all  of  the  quantitative  survey  results  (includ¬ 
ing  mean  responses  and  SEs)  are  presented  in  tabular  form  in  Appendix  B. 


Technical  Notes 

A  number  of  different  question  formats  were  used  in  the  surveys,  and  the  results  are 
stated  in  a  manner  that  is  consistent  with  the  response  options  that  were  given.  Most 
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response  formats  should  be  familiar  to  the  reader:  strongly  agree  to  strongly  disagree,  no 
emphasis  to  major  emphasis,  never  to  often.  Teachers  were  asked  how  often  they  engaged 
in  specific  teaching  techniques.  However,  some  questions  were  unique  to  this  survey. 
For  example,  a  number  of  questions  asked  how  much  a  behavior  had  changed  as  a 
result  of  the  introduction  of  a  test  or  accountability  system,  and  the  respondent  was 
given  either  four  options  ranging  from  not  at  all  to  a  great  deal  or  three  options  rang¬ 
ing  from  changed  for  the  worse  to  changed  for  the  better.  These  questions  did  not  desig¬ 
nate  a  specific  time  period  for  the  change.  Other  questions  asked  whether  an  NCLB- 
related  intervention  or  activity  had  occurred,  but  they  did  not  ask  how  often  the  event 
occurred  or  how  much  of  the  activity  had  taken  place. 

Generally,  we  report  in  the  text  only  differences  that  are  statistically  significant. 
We  do  report  a  handful  of  differences  that  are  not  statistically  significant  but  that  we 
thought  were  of  substantive  interest;  in  these  cases,  we  note  explicitly  in  the  text  that 
the  differences  are  not  statistically  significant.  Readers  can  use  the  SEs  in  Appendix 
B  to  determine  whether  other  differences  are  statistically  significant  or  whether  they 
might  be  the  result  of  measurement  or  sampling  error.  As  a  very  rough  guideline,  the 
difference  between  two  percentages  is  statistically  significant  (at  an  alpha  level  of  0.05) 
if  it  is  larger  than  twice  the  sum  of  the  SEs  associated  with  the  numbers  being  com¬ 
pared.  In  the  case  of  the  superintendent  survey,  in  which  the  number  of  respondents 
in  each  state  is  small,  the  SEs  are  large  and  only  very  large  differences  (sometimes  40 
percentage  points)  will  be  statistically  significant. 

To  make  the  monograph  easier  to  read,  we  report  quantitative  results  in  terms 
of  simple  fractions  (e.g.,  one-half  of  teachers,  one-third  of  principals)  and  we  round 
percentages  to  the  nearest  multiple  of  five.  We  also  use  relative  language  to  describe 
proportions.  We  use  the  term  almost  all  when  greater  than  85  percent  of  respondents 
answered  in  a  particular  way.  Most  is  used  when  between  60  percent  and  85  percent 
of  individuals  gave  the  same  response.  A  majority  means  more  than  50  percent,  and 
a  minority  means  less  than  50  percent.  Some  is  used  when  between  15  percent  and  40 
percent  of  respondents  answered  in  a  certain  way,  and  few  is  used  when  less  than  15 
percent  of  individuals  gave  a  particular  response.4  All  of  the  actual  results  are  presented 
in  Appendix  B. 

We  use  the  term  educator  to  include  superintendents,  principals,  and  teachers.  The 
term  administrator  refers  to  superintendents  and  principals. 


4  We  used  similar,  but  not  identical,  conventions  in  our  companion  monograph.  The  present  monograph  covers 
three  years  rather  than  two,  and  we  made  the  ranges  for  almost  all,  most,  some,  and  few  slightly  wider  because  there 
was  greater  variation  in  responses  over  time. 
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Implementation  of  SBA  in  California 


Background  on  California's  SBA  System 

California  had  already  developed  an  SBA  system  when  NCLB  was  enacted.  The  Cali¬ 
fornia  State  Board  of  Education  adopted  content  standards  for  English  language  arts 
and  mathematics  in  1997  and  science,  history,  and  social  science  in  1998  (California 
State  Board  of  Education,  2008).  These  standards  cover  all  grades  from  kindergarten 
through  twelfth  and  were  deemed  to  be  among  the  highest-quality  state  standards  in 
the  nation  by  the  Fordham  Foundation,  whose  rankings  focus  on  clarity,  rigor,  and 
quality  of  content  (Finn,  Petrilli,  and  Julian,  2006).  In  1999,  the  California  legisla¬ 
ture  passed  the  Public  School  Accountability  Act  (PSAA),  which  created  a  test-based 
accountability  system  with  three  main  components:  a  comprehensive  testing  program, 
rewards  for  successful  schools,  and  sanctions  for  underperforming  schools  (California 
Department  of  Education,  2008). 

The  testing  program  combined  commercially  available  norm-referenced  tests  and 
custom-developed  standards-based  tests.  Based  on  test  scores,  schools  were  assigned  an 
academic  performance  index  (API).  Schools’  API  scores  were  based  on  a  weighted  com¬ 
bination  of  scores  across  subjects.  At  first,  only  reading  and  math  scores  contributed  to 
the  API.  Over  time,  writing,  science,  history,  and  social  science  were  added  to  the  for¬ 
mula,  although  reading  and  math  scores  still  held  the  most  weight.  To  avoid  sanctions, 
schools  had  to  increase  their  APIs  each  year  by  5  percent  of  the  difference  between 
their  prior  scores  and  the  state  interim  target.  Schools  were  also  required  to  increase 
the  performance  of  subgroups  of  students,  although  these  targets  were  set  somewhat 
lower  because  of  the  larger  measurement  error  associated  with  smaller  groups  of  stu¬ 
dents.  The  API  was  calculated  so  that  student  gains  at  the  bottom  of  the  achievement 
spectrum  led  to  greater  increases  in  the  API  than  gains  at  the  top  of  the  achievement 
spectrum. 

The  PSAA  established  a  number  of  rewards  programs  for  high-performing  schools 
and  their  teachers,  including  the  California  Staff  Performance  Incentive  Award  and  the 
Governor’s  Performance  Award,  but  these  programs  were  not  funded  after  2000.  The 
PSAA  also  established  the  Immediate  Intervention/Underperforming  Schools  Pro¬ 
gram  (II/USP).  Under  this  program,  low-performing  schools  were  offered  monetary 
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assistance  to  develop  and  implement  school  improvement  plans  with  the  help  of  an 
external  evaluator  approved  by  the  state.  If  schools  failed  to  show  growth  in  the  two 
implementation  years  of  the  improvement  plan,  they  were  required  to  contract  with  a 
school  assistance  and  intervention  team.  In  2001,  a  new  program,  the  High  Priority 
Schools  Grant  Program  (HPSGP)  was  established  to  take  the  place  of  II/USP.  HPSGP 
is  similar  to  II/USP  but  targets  money  more  narrowly  to  the  lowest-performing  schools 
and  allows  for  a  longer  school-improvement  implementation  period.  HPSGP  was  still 
in  effect  as  of  the  2005-2006  school  year  (Harr  et  ah,  2007). 

With  the  passage  of  NCLB,  California  had  to  adapt  its  existing  SBA  system  to 
the  demands  of  the  new  federal  law.  Perhaps  most  significantly,  California  had  to 
subordinate  its  API  growth  model  for  measuring  school  performance  to  NCLB’s  AYP 
proficiency  status  model.  California  decided  to  use  API  as  the  state’s  additional  indica¬ 
tor  for  elementary  and  middle  schools,  so  the  state  did  in  part  retain  its  growth  model 
approach.  However,  the  hybrid  system  often  sent  mixed  signals  to  educators.  For  exam¬ 
ple,  in  2005  over  one-third  of  all  schools  were  successful  according  to  one  measure 
and  not  successful  according  to  the  other  measure  (O’Connell,  2006).  According  to 
state  education  officials  interviewed  in  2004  as  part  of  the  ISBA  study,  many  educators 
preferred  the  state’s  system  to  NCLB.  NCLB  also  accelerated  California’s  shift  from 
norm-referenced  tests  to  standards-based  tests,  a  change  that  was  already  starting  to 
occur  before  NCLB’s  adoption. 

Under  NCLB,  states  design  their  own  assessments  and  set  their  own  proficiency 
cutoff  scores;  studies  have  shown  that  the  difficulty  of  these  achievement  standards 
varies  a  great  deal  across  states.  California’s  proficiency  cutoff  scores  have  consistently 
been  found  to  be  some  of  the  most  challenging  among  the  states  (National  Center 
for  Education  Statistics  [NCES],  2007;  Cronin  et  ah,  2007).  According  to  NCES, 
the  proficient  level  on  California’s  fourth  grade  reading  exam  maps  out  to  just  above 
the  “basic”  level  on  the  National  Assessment  of  Educational  Progress  (NAEP),  which 
places  California  ahead  of  25  of  the  32  states  in  the  analysis  in  terms  of  rigor  and  well 
ahead  of  Georgia,  whose  fourth  grade  reading  proficient  level  corresponds  to  a  NAEP 
score  far  below  basic  (NCES,  2007). 1  The  proficient  level  on  California’s  eighth  grade 
reading  exam  maps  to  a  NAEP  score  between  basic  and  proficient,  as  does  the  pro¬ 
ficient  level  on  its  fourth  grade  mathematics  exam;  in  each  case,  California’s  exams 
ranked  higher  in  rigor  than  those  of  most  of  the  other  states  in  the  study  (NCES, 
2007).  The  Fordham  Foundation  conducted  a  similar  analysis,  mapping  state  exams 
to  the  Northwest  Evaluation  Association’s  Measures  of  Academic  Progress  (MAP)  and 
found  similar  results  for  California  (Cronin  et  ah,  2007).  The  Fordham  Foundation 
mapped  proficiency  cutoff  scores  on  state  reading  and  math  exams  in  grades  three 
through  eight  to  the  MAP,  and  in  each  case,  California  ranked  fourth  or  higher  of  the 
26  states  studied.  California,  like  the  other  states  in  our  study,  set  its  AMO  starting 


Pennsylvania  was  not  one  of  the  states  in  that  analysis. 
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point  based  on  schoolwide  average  proficiency  levels  from  the  2001-2002  school  year 
(see  Hamilton  et  ah,  2007,  footnote  5).  As  a  result,  in  the  2002-2003  school  year,  13.6 
percent  of  students  in  each  subgroup  were  required  to  be  proficient  in  English  language 
arts  (ELA),  and  16  percent  were  required  to  be  proficient  in  mathematics.  These  start¬ 
ing  points  were  markedly  lower  than  in  the  other  states  we  studied  (see  Figures  2.1 
and  2.2).  This  difference  is  due  in  part  to  differences  in  the  student  populations  in  the 
three  states  and  also  to  the  rigor  of  California’s  standards.  Because  California’s  AMO 
starting  point  was  low,  the  state’s  AMO  trajectory  is  necessarily  quite  steep,  requiring 
schools  to  substantially  increase  the  percentage  of  students  reaching  proficiency  from 
2004  to  2005  (the  middle  year  of  our  study),  and  from  2007  to  2014. 

Perhaps  partly  because  of  its  rigorous  standards,  California  has  had  higher  per¬ 
centages  of  its  schools  fail  to  make  AYP,  be  identified  for  improvement,  and  be  placed 
in  corrective  action  than  the  two  other  states  we  studied  (see  Table  2.1).  California  also 
has  a  more  diverse  student  population  than  the  other  states,  so  its  schools  are  more 
likely  to  have  significant  subgroups  for  NCLB  purposes.  Schools  with  greater  numbers 
of  subgroups  are  less  likely  to  make  AYP  because  they  must  meet  a  greater  number  of 
targets. 

Figure  2.1 

Annual  Measurable  Objectives  for  Reading  and  ELA,  Grades  Three  Through  Eight, 
by  State,  2002-2014 
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Figure  2.2 

Annual  Measurable  Objectives  for  Mathematics,  Grades  Three  Through  Eight,  by  State, 
2002-2014 


RAND  MG784-2.2 


California  Findings  from  the  ISBA  Study 

How  Did  Districts,  Schools,  and  Teachers  Respond  to  State  Accountability  Efforts, 
Including  State  Standards  and  State  Tests? 

California  mathematics  and  science  content  standards  were  perceived  to  be  useful,  but 
local  curriculum  was  not  always  aligned  with  standards.  Each  year,  over  80  percent  of 
the  mathematics  and  science  teachers  in  California  reported  that  the  state  standards 
were  useful  for  planning  their  lessons.  However,  over  three-quarters  of  mathematics 
teachers  and  about  two-thirds  of  science  teachers  reported  that  the  state  standards 
include  more  content  than  could  be  adequately  covered  in  a  school  year.  At  the  same 
time,  a  growing  minority  of  elementary  school  teachers  (about  15  percent  in  2004 
and  about  one-quarter  in  2006),  about  one-quarter  of  middle  school  math  teachers, 
and  about  40  percent  of  middle  school  science  teachers  reported  that  the  standards 
omitted  important  topics  that  were  part  of  their  curriculum.  Figure  2.3  shows  that 
despite  finding  the  standards  useful,  many  teachers  had  concerns  about  the  align¬ 
ment  of  standards  with  their  curriculum.  Thus,  in  teachers’  judgments,  the  standards 
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Table  2.1 

NCLB  Status 

School  Status 

California  (%) 

Georgia  (%) 

Pennsylvania  (%) 

2004-20053 

2005-2006b 

2004-20053 

2005-2006b 

2004-2005a 

2005-2006b 

Made  AYP 

65 

62 

82 

79 

77 

79 

Identified  for 

13 

10 

12 

10 

5 

5 

improvement 

Corrective 

2 

4 

1 

2 

1 

3 

action 

Restructuring 

3 

4 

4 

3C 

2 

3 

SOURCE:  Data  were  retrieved  from  the  state  departments  of  education  Web  sites  on  April  17,  2007. 
NOTE:  Schools  must  make  AYP  for  two  consecutive  years  to  exit  from  improvement  status,  so  some 
schools  may  be  counted  in  both  the  "made  AYP"  and  "identified  for  improvement"  rows.  The 
percentages  in  the  last  three  rows  are  mutually  exclusive. 
a  Based  on  2003-2004  testing. 
b  Based  on  2004-2005  testing. 
c  Years  four  through  nine  of  school  improvement. 


may  embody  unrealistic  expectations  for  how  much  content  can  be  covered,  and  there 
remains  some  misalignment  between  the  content  of  the  mathematics  and  science  stan¬ 
dards  and  the  content  of  their  curriculum  (see  Tables  B.l  and  B.2). 

School  and  district  administrators  were  more  likely  than  teachers  to  perceive  math¬ 
ematics  and  science  assessments  as  good  measures  of  student  achievement.  In  2006,  about 
two-thirds  of  superintendents  (down  from  95  percent  in  2004)  and  over  60  percent 
of  principals  thought  that  state  assessments  accurately  reflected  student  achievement. 
However,  in  each  year  fewer  than  one-half  of  mathematics  teachers  reported  that 
the  assessments  were  a  good  measure  of  students’  mastery  of  state  content  standards. 
Figure  2.4  shows  that  principals  were  generally  more  likely  than  teachers  to  see  state 
assessments  as  valid  indicators  of  student  achievement.  Many  mathematics  and  science 
teachers  were  also  concerned  with  the  difficulty  of  state  assessments  and  their  align¬ 
ment  with  curriculum.  Each  year,  about  one-half  of  mathematics  teachers  reported 
that  the  mathematics  assessments  were  too  difficult  for  the  majority  of  their  students, 
about  one-third  of  mathematics  teachers  reported  that  assessments  included  content 
not  in  their  curriculum,  and  about  one-third  reported  that  assessments  omitted  con¬ 
tent  that  was  in  their  curriculum.  (Teachers’  opinions  about  state  assessments  are  con¬ 
sistent  with  their  opinions  about  state  standards  reported  above.)  Higher  percentages 
of  science  teachers  agreed  that  science  assessments  were  too  difficult  for  a  majority  of 
students  and  included  content  not  in  their  curriculum  (see  Tables  B.3  to  B.5). 
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Figure  2.3 

California  Teachers  Agreeing  with  Statements  About  State  Content  Standards,  2006 
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Test  results  were  widely  available  and  were  widely  used  by  district  administrators, 
principals,  and  teachers.  Each  year,  almost  all  principals  reported  that  test  results  for 
the  school  as  a  whole,  for  student  subgroups,  and  for  content  subtopics  were  available 
to  them.  Similarly,  about  90  percent  of  mathematics  teachers  reported  that  test  results 
were  available  to  them  by  subgroup  and  by  subtopic  in  2006,  representing  a  slight 
increase  from  2004  among  elementary  school  teachers.  However,  fewer  than  half  of 
principals  and  only  about  two-thirds  of  teachers  reported  receiving  results  in  a  timely 
manner  in  each  year  (see  Tables  B.6  to  B.10). 

Each  year,  almost  all  superintendents  reported  that  assessment  results  were  help¬ 
ful  for  district  and  school  planning,  focusing  PD,  and  curriculum  reform.  Across  all 
three  years,  large  majorities  of  principals  said  they  found  the  state  test  results  useful 
for  planning  school  improvement  and  curriculum  reform,  and  for  identifying  students 
who  need  extra  support  (over  80  percent  in  each  case).  Also  in  each  year,  over  70  per¬ 
cent  of  elementary  school  principals  and  over  two-thirds  of  middle  school  principals 
found  state  test  results  to  be  useful  for  focusing  PD.  One-third  to  two-thirds  of  princi¬ 
pals  reported  that  the  data  were  useful  for  making  decisions  regarding  student  promo¬ 
tion  and  retention  and  for  identifying  teachers’  strengths  and  weaknesses  (see  Tables 
B.ll  and  B.12). 
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Figure  2.4 

California  Educators  Agreeing  That  State  Assessment  Scores  Accurately  Reflect  Student 
Achievement  (Principals)  or  Are  Good  Measures  of  Student  Mastery  (Teachers) 
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Across  the  three  years,  most  mathematics  teachers,  about  half  of  elementary  school 
science  teachers,  and  one-half  or  fewer  of  middle  school  science  teachers  said  the  state 
test  results  were  useful  for  identifying  gaps  in  curriculum  and  instruction  and  identify¬ 
ing  areas  in  which  they  needed  to  strengthen  their  content  knowledge.  About  one-half 
of  mathematics  teachers  (and  a  lower  percentage  of  science  teachers)  reported  that  the 
test  results  were  useful  for  tailoring  instruction  to  individual  student  needs.  Generally, 
middle  school  teachers  found  test  results  to  be  less  useful  in  tailoring  instruction  than 
did  elementary  school  teachers.  About  one-third  of  the  mathematics  teachers  who  had 
access  to  subgroup  results  said  they  were  useful  to  them,  and  about  two-thirds  of  math 
teachers  who  had  access  to  subtopic  results  said  they  were  useful  to  them  as  well.  Each 
year,  one-third  to  two-thirds  fewer  science  teachers  than  math  teachers  reported  that 
subgroup  and  subtopic  results  were  useful  to  them  (see  Tables  B.13,  B.8,  and  B.9). 

Superintendents  increasingly  promoted  the  use  of  periodic  progress  tests 2  in  addition 
to  the  annual  state  test,  and  teachers  found  the  progress  tests  to  be  helpful  for  improving 
teaching  and  learning.  In  2005  and  2006,  roughly  one-half  of  superintendents  reported 


2  Progress  tests  are  formal  assessments  given  periodically  during  the  year  to  measure  student  progress  in  master¬ 
ing  state  standards.  They  are  also  called  interim  tests,  formative  tests,  and  benchmark  tests.  To  our  knowledge, 
these  exams  do  not  result  in  any  consequences  for  teachers  in  the  districts  we  studied. 
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that  their  district  required  schools  to  adopt  periodic  progress  testing  to  monitor  stu¬ 
dent  learning  in  mathematics.3  The  percentage  of  math  teachers  who  reported  that 
they  were  required  to  administer  progress  tests  increased  from  2004  to  2006,  although 
the  change  was  not  statistically  significant  for  elementary  school  teachers.  According 
to  teachers,  the  progress  test  requirements  were  much  more  common  in  mathematics 
than  in  science  and  more  common  in  elementary  school  mathematics  than  in  middle 
school  mathematics.  Typically  progress  tests  were  administered  two  to  three  times  per 
year.  A  growing  majority  of  teachers  in  schools  that  used  progress  tests  reported  that 
the  progress  test  was  a  good  measure  of  student  mastery  (from  about  one-half  in  2004 
to  about  two-thirds  in  2006),  and  about  three-quarters  said  the  progress  test  helped 
them  identify  and  correct  gaps  in  curriculum  and  instruction  (see  Tables  B.14  to  B.18). 
Figure  2.5  shows  that  each  year  a  majority  of  teachers  found  both  annual  state  tests  and 
progress  tests  useful  for  identifying  and  correcting  gaps  in  curriculum  and  instruction; 
however,  larger  proportions  of  teachers  found  the  progress  tests,  as  opposed  to  the  state 
tests,  useful  for  this  purpose. 

California  educators  reported  that  they  understood  the  state  accountability  system, 
but  not  all  agreed  that  AYP  status  was  a  good  reflection  of  their  students’  performance  or 
thatAYP  targets  would  be  attained  in  future  years.  Eighty  percent  or  more  of  California 
administrators  reported  that  they  understood  the  AYP  criteria  used  in  the  state  and  that 
they  received  help  to  understand  all  the  accountability  system  requirements.  On  the 
other  hand,  about  one-half  of  teachers  reported  that  the  system  was  too  complicated  to 
understand.  Each  year,  one-half  or  more  of  school  principals  agreed  that  their  school’s 
AYP  status  reflected  the  overall  performance  of  their  students,  and  40  to  60  percent  of 
superintendents  thought  the  district’s  AYP  status  correctly  reflected  the  performance 
of  students.  Principals  in  schools  that  made  AYP  were  more  likely  to  agree  that  AYP 
was  an  accurate  reflection  of  student  performance  than  principals  in  schools  that  did 
not.  In  2006,  more  than  three-quarters  of  principals  and  superintendents  thought  their 
school  or  district  would  make  AYP  the  next  year,  but  far  fewer  (half  of  elementary 
school  principals,  one-third  of  middle  school  principals  and  fewer  than  one-quarter  of 
district  superintendents)  believed  they  would  continue  to  make  AYP  over  the  next  five 
years.  Opinions  about  whether  their  schools  and  districts  would  make  AYP  did  not 
change  much  over  the  three  years  (see  Tables  B.19  to  B.23). 

What  School  Improvement  Strategies  Were  Used,  and  Which  Were  Perceived  to  Be 
Most  Useful? 

School  improvement  efforts  incorporated  a  wide  repertoire  of  strategies.  Each  year,  almost 
all  principals  reported  using  four  strategies  to  improve  school  performance,  includ¬ 
ing  matching  curriculum  and  instruction  with  standards  and/or  assessments,  using 
existing  research,  providing  additional  instruction  to  low-performing  students,  and 
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Figure  2.5 

California  Teachers  Agreeing  That  Annual  State  Tests  and  Progress  Tests  Are  Helpful  in 
Identifying  and  Correcting  Gaps  in  Curriculum  and  Instruction 


Percentage 
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increasing  the  use  of  data.  Over  three-quarters  of  principals  reported  using  three  addi¬ 
tional  strategies,  which  included  increasing  teacher  PD,  improving  the  school  planning 
process,  and  providing  programs  outside  of  regular  school  hours.  Efforts  to  make  the 
school  more  attractive  to  parents  and  to  restructure  the  school  day  were  less  prevalent 
but  still  common,  with  more  than  half  of  principals  reporting  that  they  employed  these 
strategies.  Less  than  one-third  of  principals  reported  increasing  instructional  time  by 
lengthening  the  school  day  or  year  or  shortening  recess  (see  Table  B.24). 

Focusing  on  low-performing  students,  alignment,  and  data  use  were  the  most  impor¬ 
tant  school  improvement  strategies  according  to  principals.  For  the  most  part,  principals 
reported  focusing  on  the  same  school  improvement  strategies  each  year.  The  following 
strategies  were  reported  as  most  important  in  2005  by  the  largest  proportions  of  princi¬ 
pals:  providing  additional  instruction  to  low-performing  students  (about  40  percent  of 
elementary  school  principals  and  about  55  percent  of  middle  school  principals),  match¬ 
ing  curriculum  and  instruction  with  standards  and/or  assessments  (just  over  half  of  all 
principals),  and  increasing  the  use  of  achievement  data  to  inform  instruction  (about  70 
percent  of  elementary  school  principals  and  about  40  percent  of  middle  school  princi¬ 
pals).  Principal  reports  of  the  most  important  improvement  strategies  were  quite  simi¬ 
lar  in  2006  (see  Table  B.25). 
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California  principals  reported  that  their  schools  and  districts  engaged  in  a  wide  vari¬ 
ety  of  test  preparation  activities.  Over  85  percent  of  principals  reported  that  their  schools 
and/or  districts  were  engaged  in  one  or  more  forms  of  test  preparation.  The  most  com¬ 
monly  reported  practices  were  identifying  content  that  is  likely  to  appear  on  the  state 
test  (90  percent  or  more  each  year)  and  discussing  methods  for  preparing  students  to 
take  tests  (over  80  percent  each  year).  Smaller  majorities  of  principals  reported  that 
they  distributed  released  copies  of  the  state  test  or  test  items  and  encouraged  teachers 
to  focus  on  students  near  the  proficient  level  (bubble  kids).  About  half  of  principals 
also  distributed  commercial  test  preparation  materials  (e.g.,  practice  tests),  and  half 
encouraged  or  required  teachers  to  spend  more  time  on  tested  subjects  and  less  on 
other  subjects.  The  reported  distribution  of  released  copies  of  the  state  test  or  test  items 
increased  from  2004  to  2006  (from  about  40  percent  to  over  half),  but  it  was  still  lower 
than  in  the  other  states  we  studied,  as  was  the  use  of  commercial  test  preparation  mate¬ 
rials.  There  are  a  couple  of  possible  explanations  for  this  difference.  First,  California’s 
accountability  system  has  been  in  place  longer  than  Georgia’s  and  Pennsylvania’s,  so 
educators  and  students  may  have  been  more  familiar  with  the  state  tests  in  California. 
Second,  California  regulations  and  guidelines  published  by  the  California  Department 
of  Education  required  educators  to  limit  the  use  of  test  preparation  activities  in  order  to 
ensure  test  validity  (California  Department  of  Education,  2004).  We  found  evidence 
through  our  case  studies  that  educators  were  getting  the  message;  one  principal  told 
us,  “We  hear  horror  stories  of  ‘you’d  better  not  use  that  practice  test  because  this  is 
too  identical  to  the  CST  [California  Standards  Test],  and  we’ll  get  dinged’”  (see  Table 
B.26). 

According  to  superintendents,  districts  provided  a  range  of  support  to  principals  and 
teachers  for  school  improvement.  In  2005  and  2006,  two-thirds  or  more  of  superinten¬ 
dents  reported  that  their  district  implemented  each  of  the  following  strategies  to  help 
schools  align  curriculum  and  instruction  with  standards  in  mathematics:  providing 
sample  lessons  linked  to  state  standards,  monitoring  implementation  of  state  standards 
in  classrooms,  and  mapping  out  the  alignment  of  required  textbooks  and  instructional 
programs  to  state  standards.4  These  strategies  were  less  commonly  used  for  science; 
in  each  case,  about  one-half  of  the  districts  reported  engaging  in  the  strategy.  Each 
of  these  district  actions  was  reported  to  be  useful  in  aligning  math  curriculum  and 
instruction  to  standards  by  one-half  to  three-quarters  of  teachers  (in  general,  slightly 
fewer  than  in  the  other  two  states  we  studied)  (see  Tables  B.27  to  B.30). 

Each  year,  a  majority  of  principals  reported  that  their  districts  provided  neces¬ 
sary  assistance  to  schools  when  they  were  having  difficulties,  appropriate  support  to 
enable  principals  to  act  as  instructional  leaders,  and  appropriate  instructional  support 
for  teachers.  Each  year,  three-quarters  or  more  of  superintendents  reported  that  their 
districts  helped  some  or  all  schools  obtain  additional  PD  to  apply  the  results  of  “sci- 
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These  questions  were  not  asked  in  2004. 
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entifically  based  research”  about  education;  more  than  20  percent  of  superintendents 
reported  assigning  additional  full-time  school-level  staff  to  support  teacher  develop¬ 
ment  in  some  or  all  schools;  and  between  15  and  40  percent  provided  a  coach  or 
mentor  to  assist  the  principal  in  some  or  all  schools.  In  addition  to  PD,  three-quarters 
or  more  of  districts  provided  technical  assistance  to  some  or  all  schools  in  each  of  a 
number  of  other  areas,  including  analyzing  assessment  data,  school  improvement  plan¬ 
ning,  preparing  complete  and  accurate  data  to  comply  with  NCLB  reporting  require¬ 
ments,  implementing  effective  instructional  strategies,  and  helping  to  teach  grade-level 
standards  to  English  language  learners  (ELLs)  and  student  with  disabilities  (this  last 
question  was  not  asked  in  2004).  This  technical  assistance  was  typically  offered  to  all 
schools,  not  just  those  that  were  low  performing  (see  Tables  B.31  and  B.32). 

Superintendents  also  reported  that  districts  intervened  and  required  schools  to 
take  certain  actions  to  improve  student  performance.  For  example,  in  2006  about 
three-quarters  of  districts  required  some  or  all  elementary  and  middle  schools  to  offer 
remedial  assistance  to  students  outside  the  normal  school  day5  (an  increase  in  the  case 
of  middle  schools  from  just  under  half  in  2004).  Similarly,  a  growing  percentage  of 
districts  (from  fewer  than  half  in  2005  to  more  than  half  in  2006)  required  elementary 
schools  and  middle  schools  to  increase  the  amount  of  instruction  that  low- achieving 
students  received  in  mathematics,  but  few  required  increased  time  for  low-achieving 
students  in  science  (less  than  15  percent  each  year  for  middle  schools  and  less  than 
10  percent  each  year  for  elementary  schools).  In  addition,  a  substantial  but  decreas¬ 
ing  percentage  of  districts  required  schools,  particularly  middle  schools,  to  implement 
new  mathematics  or  science  curricula;  from  2004  to  2006,  the  percentage  of  districts 
requiring  middle  schools  to  implement  new  curricula  declined  from  more  than  60  per¬ 
cent  to  about  30  percent  in  mathematics  and  from  more  than  30  percent  to  around  15 
percent  in  science.  This  decline  makes  sense.  Early  on  in  our  study,  districts  may  have 
been  responding  to  the  new  demands  of  NCLB  by  adopting  new  curricula  that  were 
more  rigorous  and/or  better  aligned  to  state  standards.  We  would  not  expect  districts 
that  recently  adopted  new  curricula  to  revise  them  again  within  one  or  two  years  (see 
Tables  B.33  to  B.35). 

Only  17  schools  were  identified  for  improvement  in  our  sample,  so  our  estimates 
for  these  schools  are  much  less  precise  than  our  estimates  for  all  schools.  However,  in 
these  schools  the  most  common  forms  of  district  or  state  assistance  were  additional  PD 
resources,  special  grants  to  support  school  improvement,  and  a  mentor  or  coach  for  the 
principal  (e.g.,  a  distinguished  educator).  There  were  only  a  handful  of  schools  in  cor¬ 
rective  action  in  our  sample  (see  Tables  B.36  and  B.37). 

PD  emphasized  the  alignment  of  curriculum  and  instruction  with  standards  as  well 
as  other  improvement  strategies.  Each  year,  about  two-thirds  of  teachers  reported  that 
a  major  emphasis  of  the  PD  they  received  was  on  aligning  curriculum  and  instruc- 


5  Other  than  the  NCLB-required  supplemental  educational  services. 
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tion  with  standards.  In  addition,  each  of  the  following  topics  received  strong  emphasis 
according  to  about  half  of  teachers:  instructional  strategies  for  low-achieving  students, 
instructional  strategies  for  ELLs,  and  mathematics  and  mathematics  teaching.  The 
emphasis  on  ELLs  was  greater  in  California  than  in  the  other  states  we  studied.  About 
one-third  of  teachers  said  that  PD  had  a  major  focus  on  interpreting  and  using  student 
test  results,  although  this  was  more  common  among  elementary  school  teachers  than 
among  middle  school  teachers  in  2005  and  2006  (see  Table  B.38). 

According  to  superintendents,  the  California  Department  of  Education  often,  but  not 
always,  provided  needed  technical  assistance  to  their  districts.  In  2005  and  2006,  almost 
all  districts  that  reported  needing  assistance  clarifying  accountability  system  rules  and 
requirements  reported  receiving  it.6  In  each  of  the  two  years,  over  three-quarters  of  dis¬ 
tricts  that  reported  needing  help  developing  and  implementing  district  improvement 
plans  received  this  assistance  from  the  state,  and  over  half  of  districts  received  needed 
assistance  in  the  following  areas:  identifying  effective  methods  and  instructional  strate¬ 
gies  in  scientifically  based  research,  providing  effective  PD,  and  using  data  more  effec¬ 
tively.  Districts  were  more  likely  to  report  unmet  needs  in  other  areas.  Only  one-third 
to  one-half  of  districts  that  needed  assistance  developing  curricular  materials  based  on 
content  standards  received  it.  Only  about  40  percent  of  districts  that  reported  needing 
help  promoting  parent  involvement  received  assistance  from  the  state  in  this  area  in 
each  year  (see  Table  B  .39). 

What  Was  the  Impact  of  Accountability  on  Curriculum,  Teacher  Practice,  and 
Student  Learning? 

Educators’  reports  about  the  effects  of  accountability  on  curriculum  and  instruction  grew 
more  positive  from  2004  to  2006,  but  substantial  proportions  of  educators  still  believed 
that  the  accountability  system  was  having  a  negative  effect  on  morale.  The  proportion  of 
elementary  school  principals  who  agreed  that  the  academic  rigor  of  the  curriculum 
had  changed  for  the  better  grew  from  about  40  percent  to  about  80  percent  from 
2004  to  2006.  During  the  same  period,  the  proportion  of  teachers  agreeing  with  this 
statement  grew  from  about  one-third  to  about  one-half.  The  proportion  of  middle 
school  principals  agreeing  that  the  academic  rigor  of  the  curriculum  had  improved 
held  steady  from  2004  to  2006  at  50  percent.  Figure  2.6  shows  an  increase  from  2004 
to  2006  in  the  percentage  of  elementary  school  principals,  elementary  school  teach¬ 
ers,  and  middle  school  teachers  who  reported  that  academic  rigor  of  the  curriculum 
had  improved.  Fewer  than  20  percent  of  principals  or  teachers  reported  that  academic 
rigor  had  changed  for  the  worse,  and  these  percentages  declined  or  remained  about 
the  same  from  2004  to  2006.  Similar  results  were  found  regarding  schools’  focus  on 
student  learning.  For  example,  the  proportion  of  elementary  school  principals  report¬ 
ing  an  improved  focus  on  student  learning  as  a  result  of  accountability  increased  from 
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Figure  2.6 

California  Educators  Agreeing  That  the  Academic  Rigor  of  the  Curriculum  Had  Improved  as  a 
Result  of  Accountability 
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less  than  60  percent  in  2004  to  over  80  percent  in  2006.  A  growing  majority  of  ele¬ 
mentary  school  principals  (from  just  over  half  to  about  80  percent)  and  70  percent  or 
more  of  middle  school  principals  reported  that  the  accountability  system  was  beneficial 
for  students,  but  only  about  one-third  of  teachers  agreed  (see  Tables  B.40  and  B.41). 

By  2006,  about  half  of  teachers  reported  that  their  teaching  practices  had  improved 
as  a  result  of  the  accountability  system  (an  increase  from  about  one-third  in  2004).  A 
growing  minority  of  teachers  said  their  relations  with  their  students  had  improved,  as 
well  (from  less  than  15  percent  in  2004  to  about  one-quarter  in  2006  for  elementary 
school  teachers  and  from  10  percent  to  about  20  percent  for  middle  school  teachers).  A 
shrinking  majority  of  mathematics  teachers  (from  about  three-quarters  in  2004  to  just 
over  half  in  2006)  and  30  to  40  percent  of  science  teachers  reported  that  the  state  tests 
caused  them  to  search  for  more-effective  teaching  methods.  In  2006,  about  two-thirds 
of  middle  school  mathematics  teachers  and  about  half  of  middle  school  science  teachers 
said  the  state  tests  caused  them  to  offer  more  assistance  outside  of  the  school  day  to  stu¬ 
dents  who  are  not  proficient,  compared  with  about  one-quarter  of  elementary  school 
mathematics  teachers  and  10  percent  of  elementary  school  science  teachers  (responses 
were  similar  in  2004  and  2005)  (see  Tables  B.42  to  B.44). 

In  2006,  most  superintendents  and  middle  school  principals  reported  that  coor¬ 
dination  of  the  mathematics  curricula  across  grades  had  changed  for  the  better  as  a 
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result  of  accountability.  In  the  case  of  middle  school  principals,  this  represented  a  sig¬ 
nificant  increase  from  2004;  there  was  some  variation  across  years  in  the  case  of  super¬ 
intendents  but  no  easily  discernible  pattern.  Forty  to  50  percent  of  elementary  school 
principals  concurred  with  this  assessment  each  year.  Across  all  three  years,  about  one- 
quarter  of  elementary  school  principals  and  fewer  than  half  of  middle  school  principals 
reported  improvements  in  the  coordination  of  the  science  curriculum  across  grades  as 
a  result  of  accountability,  while  the  remainder  reported  no  change.  The  responses  from 
superintendents  on  the  coordination  of  the  science  curriculum  fluctuated  from  year  to 
year;  about  20  percent  reported  that  coordination  improved  in  2004  compared  with 
just  over  one-half  in  2005,  and  less  15  percent  in  2006  (see  Table  B.45). 

Finally,  about  three-quarters  of  superintendents,  just  under  one-half  of  teachers 
and  elementary  school  principals,  and  one  in  five  middle  school  principals  reported 
that  staff  morale  had  changed  for  the  worse  as  a  result  of  the  accountability  system 
in  2006  (see  Figure  2.7).  Fewer  principals  and  teachers  reported  a  negative  effect  on 
morale  in  2006  than  in  2004,  and  this  decrease  was  especially  marked  in  the  case  of 
principals  (see  Table  B.46). 

Teachers  responded  to  standards- based  accountability  by  aligning  their  curriculum 
with  standards  but  did  not  report  changing  specific  teaching  techniques.  Teachers  reported 
making  a  lot  of  changes  in  curriculum  and  instruction  in  response  to  standards-based 
accountability.  Perhaps  the  most  widespread  change  involved  aligning  curriculum 
and  instruction  with  standards  and,  to  a  lesser  extent,  with  assessments.  In  each  year, 
almost  all  math  teachers  and  over  three-quarters  of  science  teachers  reported  that  they 
had  aligned  their  instruction  with  the  standards;  more  than  half  of  all  teachers  also 
reported  aligning  instruction  with  the  state  assessments  (see  Table  B.47). 

The  state  tests  were  an  explicit  factor  in  teachers’  reported  changes  in  practice. 
Each  year,  over  two-thirds  of  elementary  school  math  teachers  and  just  under  half  of 
elementary  school  science  teachers  reported  that  they  focused  more  on  standards  as  a 
result  of  the  state  test.  About  two-thirds  of  elementary  school  math  teachers  and  about 
one-quarter  of  elementary  school  science  teachers  also  reported  focusing  more  on  topics 
emphasized  on  the  assessment  because  of  the  state  test.  Somewhat  smaller  proportions 
of  middle  school  teachers  reported  focusing  more  on  standards  and  topics  emphasized 
on  the  assessment  as  a  result  of  the  state  test  (see  Tables  B.43  and  B.44). 

It  appears  that  teachers’  efforts  to  improve  alignment  did  not  typically  involve 
changing  the  amount  of  time  devoted  to  specific  subjects,  at  least  during  the  time 
period  we  studied.  In  each  year,  one-half  to  two-thirds  of  teachers  reported  no  changes 
in  the  amount  of  time  students  spent  in  each  of  the  following  subjects:  mathematics, 
reading/language  arts,  science,  social  studies,  arts/music,  and  physical  education.  In 
2006,  about  20  percent  of  elementary  school  teachers  reported  increases  in  the  time 
they  spent  on  mathematics  (a  slight  decline  from  2004),  and  about  30  percent  reported 
increases  in  time  for  reading/language  arts.  Smaller  proportions  of  middle  school  teach¬ 
ers  reported  increases  in  time  in  math  and  reading.  There  were  few  reports  of  decreases 
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Figure  2.7 

California  Educators  Agreeing  That  Staff  Morale  Had  Changed  for  the  Worse  as  a  Result  of 
Accountability 
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in  time  on  these  two  subjects.  However,  some  elementary  school  teachers  indicated 
that  they  decreased  the  amount  of  time  they  spent  on  arts/music,  social  studies,  or  sci¬ 
ence  (between  15  and  28  percent  for  each  subject  in  each  year).  It  is  important  to  note 
that  we  asked  teachers  about  changes  over  the  past  year  in  the  amount  of  time  allocated 
to  subjects.  As  a  result,  teachers’  responses  would  not  be  expected  to  reflect  cumulative 
changes  since  the  enactment  of  NCLB.* 7  Thus,  it  is  possible  that  these  findings  underes¬ 
timate  the  amount  of  time  reallocated  between  subjects  as  a  result  of  NCLB’s  account¬ 
ability  provisions  (see  Tables  B.48  and  B.49). 

In  general,  elementary  and  middle  school  mathematics  and  science  teachers’ 
reports  about  particular  teaching  techniques  were  similar  and  did  not  change  much 
from  2005  to  2006. 8  Almost  all  mathematics  teachers  reported  that  they  sometimes 
or  often  used  most  of  the  techniques  mentioned  in  the  survey,9  including  introduc¬ 
ing  content  through  formal  presentations  or  direct  instruction,  assigning  homework, 
reviewing  assessments,  reteaching  topics  because  performance  did  not  meet  expec- 


In  addition,  we  did  not  track  individual  teacher  responses  over  time,  so  we  cannot  combine  reported  annual 

changes  across  the  three  years  to  estimate  cumulative  change. 

8  We  did  not  ask  this  question  in  2004. 

9  Sometimes  was  defined  as  once  or  twice  per  month;  often  was  defined  as  once  a  week  or  more. 
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tations,  and  having  students  help  other  students  learn  content.  Over  half  of  science 
teachers  reported  using  the  techniques  listed  above.  In  contrast,  only  about  45  percent 
of  elementary  school  mathematics  teachers  and  one-third  of  middle  school  mathemat¬ 
ics  teachers  reported  having  students  work  on  extended  mathematics  investigations 
or  projects  in  each  year.  In  both  2005  and  2006,  about  70  percent  of  elementary 
school  science  teachers  and  about  80  percent  of  middle  school  science  teachers  reported 
having  students  do  hands-on  laboratory  science  activities  or  investigations  (see  Tables 
B.50  to  B.53). 

About  half  of  teachers  were  concerned  that  the  focus  on  test  scores  deprived  high- 
achieving  students  of  challenging  curriculum.  About  one-half  of  teachers  reported  in  2005 
and  2006  that  high- achieving  students  were  not  receiving  an  appropriately  challeng¬ 
ing  curriculum  as  a  result  of  the  accountability  system.10  Other  survey  responses  offer 
possible  explanations  for  this  concern.  Each  year,  over  80  percent  of  teachers  felt  that 
the  accountability  system  left  little  time  to  teach  material  that  is  not  on  the  state  test. 
This  can  be  viewed  as  a  positive  outcome  given  that  SBA  is  designed  to  ensure  that  stu¬ 
dents  master  the  content  outlined  in  state  standards  and  measured  by  the  assessments. 
However,  this  narrow  focus  on  the  standards  may  exclude  teaching  advanced  material 
that  could  benefit  high- achieving  students.  We  also  found  evidence  that  some  teachers 
were  giving  special  attention  to  certain  groups  of  students.  In  2006,  over  one-third  of 
math  teachers  (representing  a  slight  increase  among  elementary  school  math  teachers) 
and  over  10  percent  of  science  teachers  said  the  state  tests  caused  them  to  focus  more 
on  students  near  the  proficient  level  (bubble  kids)  than  they  would  have  absent  the  tests 
(perhaps  at  the  expense  of  students  farther  to  the  extremes  of  the  achievement  spec¬ 
trum)  (see  Tables  B.54,  B.43,  and  B.44). 

What  Conditions  Hindered  Improvement  Efforts? 

Inadequate  funding,  inadequate  materials,  and  insufficient  time  were  the  factors  most 
often  reported  to  hinder  efforts  to  improve  performance.  Resources  are  always  a  concern 
in  education,  and  each  year  more  than  80  percent  of  superintendents  and  more  than 
60  percent  of  principals  reported  that  lack  of  adequate  funding  was  a  moderate  to 
great  hindrance  to  their  improvement  efforts.  In  contrast,  each  year  fewer  than  one- 
third  of  superintendents  or  principals  reported  that  inadequate  facilities  interfered  with 
improvement  efforts.  In  2006,  about  15  percent  of  superintendents  said  shortages  of 
standards-based  curriculum  materials  were  a  problem,  down  from  about  one-third  in 
2004.  Each  year,  one-quarter  to  one-third  of  teachers  reported  that  inadequate  instruc¬ 
tional  materials  hindered  students’  academic  success  (see  Tables  B.55  and  B.56). 

Shortages  of  time  to  perform  administrative  functions,  prepare  for  lessons,  and 
deliver  instruction  were  also  reported  to  hinder  improvement  efforts.  In  2005  and 
2006,  about  two-thirds  of  principals  reported  that  their  administrative  staff  had  insuf- 
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ficient  time  to  perform  their  duties.11  Each  year,  over  one-half  of  middle  school  teachers 
and  over  70  percent  of  elementary  school  teachers  reported  that  there  was  insufficient 
class  time  to  cover  the  curriculum.  In  addition,  in  2005  and  2006  over  half  of  elemen¬ 
tary  school  teachers  and  about  40  percent  of  middle  school  teachers  reported  that  there 
was  inadequate  planning  time  built  into  the  school  day.  Responses  from  principals 
were  similar;  about  40  percent  of  middle  school  principals  and  more  than  one-half  of 
elementary  school  principals  reported  that  lack  of  teacher  planning  time  was  a  hin¬ 
drance  to  school  improvement  in  both  2005  and  200612  (see  Tables  B.57  to  B.59). 

Teachers  reported  that  large  class  sizes  and  a  wide  range  of  student  abilities  in  class 
were  hindrances  to  student  academic  success.  Each  year,  about  three-quarters  of  teach¬ 
ers  reported  that  the  wide  range  of  student  abilities  they  had  to  address  in  class  was  a 
hindrance  to  students’  academic  success.  Similarly,  about  two-thirds  of  middle  school 
teachers  and  over  half  of  elementary  school  teachers  reported  that  large  class  sizes  hin¬ 
dered  students’  academic  success  (see  Tables  B.60  and  B.56). 

Most  superintendents  reported  that  districts  had  adequate  capacity  to  support  school 
improvement.  Across  all  three  years,  majorities  of  superintendents  reported  that  their 
districts  had  adequate  staff  capacity  to  provide  schools  support  in  most  areas  we  stud¬ 
ied.  These  areas  included  facilitating  improvement  in  low-performing  schools,  helping 
schools  analyze  data  for  school  improvement,  and  aligning  curriculum  with  standards. 
More  than  half  of  superintendents  reported  that  they  had  adequate  capacity  to  provide 
PD  for  principals  and  teachers  in  2004  and  2006  (for  some  unknown  reason,  capacity 
to  conduct  PD  dipped  in  2005)  (see  Table  B.61). 

Many  superintendents  and  principals  reported  that  improvement  efforts  were  hin¬ 
dered  by  shortages  of  key  staff  and  shortages  of  high-quality  PD.  In  2006,  three-quarters  of 
superintendents  reported  that  shortages  of  mathematics  teachers  hindered  improvement 
efforts,  and  60  percent  of  superintendents  reported  that  shortages  of  science  teachers 
were  a  hindrance,  reflecting  marked  increases  from  2005. 13  In  addition,  each  year  about 
40  percent  of  superintendents  reported  that  their  improvement  efforts  were  hindered 
by  shortages  of  high-quality  PD  opportunities  for  principals  or  teachers,  and  principals 
responded  similarly.  About  one-quarter  of  principals  reported  a  lack  of  highly  quali¬ 
fied  teachers  in  2006,  and  a  similar  percentage  reported  shortages  of  qualified  aides  or 
paraprofessionals  (responses  were  similar  across  the  three  years)  (see  Table  B.57). 

Most  teachers  reported  that  students’  lack  of  basic  skills  and  lack  of  parental  support 
impeded  their  efforts  to  improve  student  achievement.  Across  the  three  years,  75  to  80 
percent  of  teachers  reported  that  their  efforts  to  improve  student  achievement  were 
hindered  by  students’  inadequate  basic  skills  or  prior  preparation.  Similar  percentages 
of  teachers  reported  that  they  were  hindered  in  their  efforts  to  improve  student  per- 


11  We  did  not  ask  this  question  in  2004. 

12  We  did  not  ask  this  question  in  2004. 

13  We  did  not  ask  this  question  in  2004. 
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formance  by  lack  of  support  from  parents.  For  example,  the  responses  from  California 
teachers  in  2006  are  displayed  in  Figure  2.8.  Student  absenteeism  and  tardiness  were 
concerns  for  slightly  smaller  proportions  of  teachers  (see  Table  B.60). 

Most  administrators  reported  that  changes  in  state  policies  and  state  leadership,  as 
well  as  compliance  with  teacher  association  policies,  were  impediments  to  improvement. 
Each  year,  more  than  two-thirds  of  superintendents  said  frequent  changes  in  state 
policy  or  leadership  were  hindrances  to  improvement.  On  the  other  hand,  few  super¬ 
intendents  reported  that  disagreements  with  their  school  boards  over  policies  hindered 
their  improvement  efforts,  although  this  was  an  issue  in  one-quarter  to  one-third  of 
districts  in  the  other  states  we  studied.  Each  year,  more  than  one-half  of  superinten¬ 
dents  reported  that  complying  with  teacher  association  rules  or  policies  hindered  their 
improvement  efforts.  About  10  percent  of  middle  school  principals  and  one-third  of 
elementary  school  principals  said  frequent  changes  in  district  policy  or  district  leader¬ 
ship  hindered  their  improvement  efforts  in  2006  (see  Table  B.62). 

Some  principals  reported  that  alack  of  guidance  for  teaching  special-needs  populations 
was  a  hindrance  to  their  school  improvement  efforts.  In  2005  and  2006,  over  one-third  of 
elementary  school  principals  and  over  one-quarter  of  middle  school  principals  reported 
that  a  lack  of  guidance  for  teaching  standards  for  special  education  students  (i.e.,  students 

Figure  2.8 
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in  individualized  education  programs  [IEPs])  was  a  moderate  or  great  hindrance  to 
their  school  improvement  efforts.  About  half  of  elementary  school  principals  and  a 
growing  minority  of  middle  school  principals  (from  about  15  percent  in  2005  to  about 
45  percent  in  2006)  cited  the  same  concern  in  reference  to  ELLs.  Elementary  school 
principals  in  California  were  more  likely  to  report  that  a  lack  of  guidance  for  teaching 
ELLs  hindered  their  school  improvement  efforts  than  were  elementary  school  princi¬ 
pals  in  Georgia  and  Pennsylvania  (see  Table  B.63).  This  is  consistent  with  the  fact  that 
California  has  a  higher  percentage  of  ELLs  than  do  the  other  two  states. 
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Background  on  Georgia's  SBA  System 

Georgia  was  in  the  process  of  creating  an  SBA  system  in  2001  when  NCLB  was  enacted. 
Georgia  has  had  academic  standards  in  some  form  for  over  20  years.  The  state  Quality 
Basic  Education  Act  of  1985  created  the  Quality  Core  Curriculum  (QCC),  which  cov¬ 
ered  reading,  ELA,  mathematics,  science,  social  studies,  foreign  languages,  fine  arts, 
health,  physical  education,  technology  and  career  education,  and  agriculture.  The  stan¬ 
dards  described  what  students  should  learn  in  each  grade  from  kindergarten  to  eight 
and  in  high  school  focusing  primarily  on  facts  to  be  learned  rather  than  broader  con¬ 
cepts.  Elowever,  an  external  audit  by  Phi  Delta  Kappa  in  2002  found  the  QCC  to  be 
of  poor  quality,  citing  lack  of  depth,  focus,  and  alignment  to  national  standards  (Geor¬ 
gia  Department  of  Education,  undated).1  In  response  to  the  audit,  Georgia  launched 
an  initiative  in  2002  to  develop  new  standards.  In  2003,  the  state  board  of  education 
began  adopting  the  Georgia  Performance  Standards  (GPS),  a  more  concept-focused 
document.  The  Fordham  Foundation  gave  the  new  standards  high  marks,  citing  their 
clarity,  detail,  and  organization  (Finn,  Petrilli,  and  Julian,  2006). 

Georgia  also  had  a  comprehensive  testing  program  prior  to  NCLB,  which 
included  tests  in  reading,  mathematics,  and  science  in  grades  one  to  eight.  These  tests 
were  revised  following  the  adoption  of  GPS  to  align  with  the  new  standards.  In  2000, 
the  Georgia  State  A  Plus  Education  Reform  Act  created  a  test-based  accountability 
system  patterned  on  those  in  Texas  and  North  Carolina.  Under  this  system,  schools 
were  to  be  awarded  a  letter  grade  (A— F),  which  would  determine  whether  the  school 
received  rewards  or  was  subjected  to  sanctions.  NCLB  was  enacted  just  as  A  Plus  was 
being  implemented,  and  subsequently  the  system  was  altered  to  conform  to  the  federal 
policy. 


1  In  a  2004  review  of  the  Georgia  performance  standards,  Phi  Delta  Kappa  evaluated  the  standards’  validity 
by  comparing  them  with  national  standards  published  by  the  International  Reading  Association,  the  National 
Council  for  Teachers  of  English,  the  National  Council  of  Teachers  of  Mathematics,  the  National  Council  for  the 
Social  Studies,  and  the  National  Committee  on  Science  Education  Standards  and  Assessment  (see  Poston  et  ah, 
2004). 
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In  2005,  Georgia  introduced  the  state  single  accountability  system  (SSAS),  which 
integrated  A  Plus  with  NCLB,  and  this  remains  the  current  SBA  system  in  Georgia. 
Under  SSAS,  AYP  is  the  dominant  measure  of  school  performance.  SSAS  also  includes 
rewards  for  schools  with  the  highest  percentage  of  students  meeting  or  exceeding  stan¬ 
dards  on  the  state  assessments  and  for  Title  I  schools  that  make  AYP  for  three  or  more 
consecutive  years.  Sanctions  for  consistently  underperforming  schools  include  school- 
level  interventions  (e.g.,  appointing  instructional  coaches,  replacing  staff,  and  making 
governance  changes)  and  district-level  interventions  (e.g.,  appointment  of  a  school  dis¬ 
trict  support  specialist).  If  schools  continue  to  underperform,  they  can  be  compelled  to 
enter  into  an  improvement  contract  with  their  school  district,  which  includes  oversight 
by  the  Georgia  Department  of  Education. 

Georgia’s  achievement  standards  have  been  found  to  be  less  rigorous  than  those 
of  California.  According  to  an  analysis  by  NCES,  which  mapped  state  proficiency 
standards  onto  NAEP,  Georgia’s  achievement  standards  for  fourth  and  eighth  grade 
reading  and  mathematics  are  among  the  lowest  of  the  36  states  studied  (NCES,  2007). 
The  proficient  level  on  the  Georgia  fourth  grade  mathematics  assessment  is  equivalent 
to  the  low  end  of  the  “basic”  range  on  NAEP,  and  the  proficient  level  on  the  eighth 
grade  mathematics  assessment  and  the  fourth  and  eighth  grade  reading  assessments 
corresponds  to  “below-basic”  NAEP  scores.  Like  the  other  states  in  our  study,  Georgia 
based  its  AMO  starting  point  on  schoolwide  average  proficiency  scores  from  2001- 
2002.  In  2002-2003,  50  percent  of  students  were  expected  to  demonstrate  proficiency 
in  mathematics  and  60  percent  were  expected  to  demonstrate  proficiency  in  reading 
and  ELA.  These  starting  points  were  substantially  higher  than  those  in  California  and 
Pennsylvania,  perhaps  reflecting  the  lesser  difficulty  of  Georgia’s  academic  standards 
(see  Figures  2.1  and  2.2).  Because  Georgia  has  less  ground  to  make  up  than  California 
and  Pennsylvania  in  reaching  100  percent  proficiency,  its  AMO  trajectory  is  less  steep. 
In  addition,  the  required  gains  are  most  heavily  concentrated  from  2010  to  2014.  As 
with  the  other  two  states  in  our  study,  Georgia’s  AMO  target  increased  in  the  middle 
year  of  our  data  collection,  2004-2005,  but  not  in  the  other  two  years  in  which  we 
collected  data. 

In  2005-2006,  79  percent  of  Georgia  schools  were  identified  as  having  made 
AYP  based  on  the  previous  year’s  test  scores,  a  significantly  higher  percentage  than  in 
California  and  roughly  equal  to  the  percentage  in  Pennsylvania.  Nevertheless,  Geor¬ 
gia  had  a  higher  percentage  of  its  schools  in  improvement  status,  corrective  action,  or 
restructuring  than  did  Pennsylvania  (see  Table  2.1). 
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Georgia  Findings  from  the  ISBA  Study 

How  Did  Districts,  Schools,  and  Teachers  Respond  to  State  Accountability  Efforts, 
Including  State  Standards  and  State  Tests? 

Georgia  mathematics  and  science  standards  were  perceived  to  be  useful,  but  local  curricu¬ 
lum  was  not  always  aligned  with  standards.  Each  year,  over  80  percent  of  mathemat¬ 
ics  and  science  teachers  in  Georgia  reported  that  the  state  standards  were  useful  for 
planning  their  lessons.  However,  in  2006  about  one-half  of  mathematics  teachers  and 
science  teachers  reported  that  the  state  standards  include  more  content  than  could  be 
adequately  covered  in  a  school  year.  The  percentages  of  math  and  science  teachers  who 
reported  that  the  standards  included  too  much  content  declined  by  almost  20  points 
during  the  three  years  of  the  study,  and  they  were  lower  than  the  percentages  in  the 
other  states  we  studied.  In  all  three  years  and  in  both  subjects  (mathematics  and  sci¬ 
ence),  more  middle  school  teachers  than  elementary  school  teachers  reported  that  the 
standards  contained  more  content  than  could  reasonably  be  covered  in  a  year.  This 
response  was  given  despite  the  fact  that  the  new  GPS  for  mathematics  were  imple¬ 
mented  in  the  sixth  grade  in  2004-2005  and  in  the  seventh  grade  in  2005-2006.  New 
GPS  for  science  were  implemented  in  middle  schools  in  2004-2005  and  in  grades  three 
through  five  the  next  year.  At  the  same  time,  over  20  percent  of  mathematics  teachers 
and  about  one-third  of  science  teachers  reported  each  year  that  the  standards  omit¬ 
ted  important  topics  that  were  part  of  their  curriculum.  Figure  3.1  shows  that  despite 
finding  the  standards  useful,  many  teachers  had  concerns  about  the  alignment  of  stan¬ 
dards  with  their  curriculum.  Thus,  in  teachers’  judgments,  the  standards  may  embody 
unrealistic  expectations  for  how  much  content  can  be  covered,  and  there  remains  some 
misalignment  between  the  content  of  the  mathematics  and  science  standards  and  the 
content  of  the  curriculum  (see  Tables  B.l  and  B.2). 

School  and  district  administrators  were  more  likely  than  teachers  to  perceive  mathe¬ 
matics  and  science  assessments  as  good  measures  of  student  achievement.  Consistently  across 
the  three  years,  over  two-thirds  of  superintendents  and  about  two-thirds  of  principals 
thought  that  state  assessments  accurately  reflected  student  achievement.  However,  in 
each  year  only  slightly  more  than  half  of  mathematics  teachers  and  slightly  fewer  than 
half  of  science  teachers  reported  that  the  assessments  were  a  good  measure  of  students’ 
mastery  of  standards.  Figure  3.2  shows  that  principals  were  more  likely  than  teachers 
to  see  state  assessments  as  valid  indicators  of  student  achievement.  Given  that  substan¬ 
tial  proportions  of  teachers  did  not  believe  that  state  assessments  were  good  measures 
of  students’  content  mastery,  it  is  not  surprising  that  sizable  minorities  of  teachers 
reported  concerns  about  these  assessments.  One-fourth  to  one-third  of  mathematics 
teachers  reported  that  the  mathematics  assessments  were  too  difficult  for  the  majority 
of  their  students,  included  content  not  in  their  curriculum,  or  omitted  content  that  was 
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Figure  3.1 

Georgia  Teachers  Agreeing  with  Statements  About  State  Content  Standards,  2006 


Standards  do  not  cover  some 
important  content  areas 


Standards  include  more  content 
than  can  adequately  be 
covered  in  the  school  year 


Standards  are  useful  for 
planning  lessons 


0  10  20  30  40  50  60  70  80  90  100 

Percentage 

RAND  MG 784  8.1 

in  their  curriculum.  Slightly  higher  percentages  of  science  teachers  found  fault  with  the 
science  assessments  on  the  same  grounds.  However,  in  general,  Georgia  educators  were 
more  favorable  toward  the  quality  of  state  assessments  than  were  educators  in  the  other 
states  we  studied  (see  Tables  B.3  to  B.5). 

Test  results  were  widely  available  and  were  widely  used  by  district  administrators, 
principals,  and  teachers.  Test  results  were  available  in  a  variety  of  formats,  and  they 
appeared  to  be  available  in  a  much  more  timely  manner  in  2006  than  2004.  Each 
year,  almost  all  principals  reported  that  test  results  for  the  school  as  a  whole,  for  stu¬ 
dent  subgroups,  and  for  subtopics  were  available  to  them.  Similarly,  over  85  percent  of 
mathematics  teachers  and  three-quarters  of  science  teachers  reported  that  test  results 
were  available  to  them  by  subgroup  and  by  subtopic  in  2006  (an  increase  from  2004). 
By  2006,  over  one-half  of  principals  and  three-quarters  of  teachers  reported  receiving 
results  in  a  timely  manner  (an  increase  from  fewer  than  one-quarter  of  principals  and 
fewer  than  half  of  teachers  in  2004)  (see  Tables  B.6  to  B.10). 

Each  year,  almost  all  superintendents  reported  that  assessment  results  were  helpful 
for  district  and  school  planning,  focusing  PD,  and  curriculum  reform.  Three-quarters 
or  more  of  principals  said  they  found  the  state  test  results  useful  for  each  of  the  follow¬ 
ing  activities:  planning  school  improvement,  PD,  curriculum  reform,  and  identifying 
students  who  need  extra  support.  Increasing  majorities  of  principals  also  reported  that 
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Figure  3.2 

Georgia  Educators  Agreeing  That  States  Assessment  Scores  Accurately  Reflect  Student 
Achievement  (Principals)  or  Are  Good  Measures  of  Student  Mastery  (Teachers) 
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the  data  were  useful  for  making  decisions  regarding  student  promotion  and  reten¬ 
tion  (from  about  70  percent  in  2004  to  about  90  percent  in  2006)  and  for  identifying 
teachers’  strengths  and  weaknesses  (from  about  two-thirds  in  2004  to  about  three- 
quarters  in  2006)  (see  Tables  B.ll  and  B.12). 

Each  year,  over  two-thirds  of  teachers  said  the  state  test  results  were  useful  for 
identifying  gaps  in  curriculum  and  instruction,  identifying  areas  in  which  they  needed 
to  strengthen  their  content  knowledge,  and  tailoring  instruction  to  individual  student 
needs  (higher  percentages  than  in  the  other  states  we  studied).  In  2005  and  2006,  just 
over  half  of  the  mathematics  teachers  who  had  access  to  subgroup  results  said  they  were 
useful  to  them,  and  over  three-quarters  who  had  access  to  subtopic  results  said  they 
were  useful  to  them,  as  well  (both  sets  of  responses  increased  from  2004)  (see  Tables 
B.13,  B.8,  and  B.9). 

Superintendents  promoted  the  use  of  periodic  progress  tests1  2  in  addition  to  the  annual 
state  test,  and  teachers  found  the  progress  tests  to  be  helpful  for  improving  teaching  and 
learning.  In  2005  and  2006,  over  70  percent  of  superintendents  reported  that  their 


1  Progress  tests  are  formal  assessment  given  periodically  during  the  year  to  measure  student  progress  in  master¬ 

ing  state  standards.  They  are  also  called  interim  tests,  formative  tests,  and  benchmark  tests.  To  our  knowledge, 
these  exams  do  not  result  in  any  consequences  for  teachers  in  the  districts  we  studied. 
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district  required  schools  to  administer  periodic  progress  tests  to  monitor  student  learn¬ 
ing  in  mathematics,  and  40  to  65  percent  required  progress  tests  in  science  (consid¬ 
erably  higher  than  in  the  other  states  we  studied).3  The  percentage  of  math  teach¬ 
ers  who  reported  that  they  were  required  to  administer  progress  tests  increased  from 
2004  to  2006  (although  the  difference  was  not  statistically  significant  in  the  case  of 
middle  school  teachers).  According  to  teachers,  the  progress  test  requirements  were 
most  common  for  elementary  school  math,  followed  by  middle  school  math,  middle 
school  science,  and  finally  elementary  school  science.  Most  frequently,  progress  tests 
were  administered  every  six  to  eight  weeks,  although  many  teachers  also  reported  prog¬ 
ress  tests  being  administered  only  two  to  three  times  per  year.  Each  year,  over  60  per¬ 
cent  of  teachers  in  schools  that  used  progress  tests  reported  that  the  progress  test  was  a 
good  measure  of  student  mastery  (a  slightly  higher  percentage  than  for  the  annual  state 
tests)  and  that  the  progress  tests  helped  them  identify  and  correct  gaps  in  curriculum 
and  instruction.  Figure  3.3  shows  that  each  year  most  elementary  school  teachers  and 
middle  school  teachers  found  annual  state  tests  and  progress  tests  useful  for  identify¬ 
ing  and  correcting  gaps  in  curriculum  and  instruction.  The  use  of  progress  testing  was 

Figure  3.3 

Georgia  Teachers  Agreeing  That  Annual  State  Tests  and  Progress  Tests  Are  Helpful  in 
Identifying  and  Correcting  Gaps  in  Curriculum  and  Instruction 
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3  We  did  not  ask  this  question  in  2004. 
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more  common  in  Georgia  than  in  the  other  states  we  studied,  especially  for  science  (see 
Tables  B.14  to  B.18). 

Georgia  educators  reported  that  they  understood  the  state  accountability  system,  but 
not  all  agreed  that  AYP  status  was  a  good  reflection  of  their  students’  performance  or  that 
AYP  targets  would  be  attained  in  future  years.  Each  year,  nearly  all  Georgia  administra¬ 
tors  reported  that  they  understood  the  AYP  criteria  being  used  in  the  state  and  that 
they  received  help  to  understand  all  the  accountability  system  requirements.  However, 
a  declining  proportion  of  elementary  school  teachers  (from  one-half  in  2004  to  just 
over  one-third  in  2006)  and  over  40  percent  of  middle  school  teachers  reported  that 
the  system  was  too  complicated  to  understand.  By  2006,  over  80  percent  of  elemen¬ 
tary  school  principals  agreed  that  their  school’s  AYP  status  reflected  the  overall  perfor¬ 
mance  of  their  students  (up  from  about  two-thirds  in  2004),  but  slightly  fewer  than 
half  of  middle  school  principals  and  superintendents  concurred.  Principals  in  schools 
that  made  AYP  were  more  likely  to  agree  that  AYP  was  an  accurate  reflection  of  stu¬ 
dent  performance  than  principals  in  schools  that  did  not.  In  2006,  almost  all  principals 
and  superintendents  thought  their  schools  or  districts  would  make  AYP  the  next  year 
(an  increase  from  2004  for  both  superintendents  and  middle  school  principals),  and  a 
somewhat  smaller  majority  of  principals  and  superintendents  believed  they  would  con¬ 
tinue  to  make  AYP  over  the  next  five  years  (see  Tables  B.19  to  B.23). 

What  School  Improvement  Strategies  Were  Used  and  Which  Were  Perceived  to  Be 
Most  Useful? 

School  improvement  efforts  incorporated  a  wide  repertoire  of  strategies.  Each  year,  almost 
all  principals  reported  using  seven  strategies  to  improve  school  performance,  including 
matching  curriculum  and  instruction  with  standards  and/or  assessments,  using  exist¬ 
ing  research,  providing  additional  instruction  to  low-performing  students,  increasing 
the  use  of  data,  increasing  teacher  PD,  improving  the  school  planning  process,  and 
providing  programs  outside  of  regular  school  hours.  Less  prevalent,  but  still  commonly 
reported  by  principals,  were  efforts  to  make  the  school  more  attractive  to  parents  (two- 
thirds  to  three-quarters  of  principals  each  year),  to  restructure  the  school  day  (over  one- 
half  of  principals  each  year),  and  to  lengthen  the  school  day  or  school  year  (one-third 
to  one-half  of  principals)  (see  Table  B.24). 

Alignment,  data  use,  and  focusing  on  low-performing  students  were  the  most  impor¬ 
tant  school  improvement  strategies  according  to  principals.  In  both  2005  and  2006,  the 
strategies  reported  as  most  important  by  the  largest  proportions  of  principals  were 
matching  curriculum  and  instruction  with  standards  and/or  assessments  (over  half  of 
all  principals  each  year),  increasing  the  use  of  achievement  data  to  inform  instruction 
(60  percent  or  more  of  principals  each  year),  and  providing  additional  instruction  to 
low-performing  students  (just  under  half  of  principals  each  year)  (see  Table  B.25). 

Georgia  principals  reported  that  their  schools  and  districts  engaged  in  a  wide  variety 
of  test  preparation  activities.  Each  year,  almost  all  principals  reported  that  their  schools 
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and/or  districts  were  engaged  in  one  or  more  forms  of  test  preparation,  including  iden¬ 
tifying  content  that  is  likely  to  appear  on  the  state  test,  discussing  methods  for  pre¬ 
paring  students  to  take  tests,  distributing  released  copies  of  the  test  or  test  items,  and 
encouraging  teachers  to  focus  on  students  near  the  proficient  level  (bubble  kids)  (see 
Table  B.26). 

According  to  superintendents,  districts  provided  a  range  of  support  to  principals  and 
teachers  for  school  improvement.  In  2005  and  2006,  60  percent  or  more  of  superinten¬ 
dents  reported  that  their  districts  implemented  each  of  the  following  strategies  to  help 
schools  align  curriculum  and  instruction  with  standards  in  mathematics  and  science: 
providing  feedback  on  the  implementation  of  standards  in  classrooms,  aligning  text¬ 
books  and  instructional  programs  with  standards  and  assessments,  developing  “pacing 
plans”  or  “instructional  calendars,”  establishing  detailed  curriculum  guidelines,  and 
providing  sample  lessons.4  Teachers  typically  found  these  district  support  strategies  to 
be  useful  in  aligning  math  curricula  and  instruction  with  standards  (see  Tables  B.27 
to  B.30). 

Each  year,  more  than  three-quarters  of  principals  reported  that  their  district  pro¬ 
vided  needed  assistance  to  schools  when  they  were  having  difficulties,  appropriate  sup¬ 
port  to  enable  principals  to  act  as  instructional  leaders,  and  appropriate  instructional 
support  for  teachers.  Each  year,  almost  all  superintendents  reported  that  their  districts 
helped  some  or  all  schools  obtain  additional  PD  based  on  scientifically  based  research, 
and  more  than  half  provided  a  coach  or  mentor  to  assist  the  principal  in  some  or  all 
schools.  More  than  two-thirds  of  superintendents  reported  assigning  additional  full¬ 
time  school-level  staff  to  support  teacher  development  in  some  or  all  schools  in  2006, 
up  from  about  40  percent  in  2004.  Georgia  superintendents  were  more  likely  to  report 
providing  staff  to  support  teacher  development  and  coaches  for  principals  than  were 
superintendents  in  the  other  states  we  studied.  In  addition  to  PD,  almost  all  districts 
provided  technical  assistance  to  schools  in  a  number  of  other  areas,  including  analyz¬ 
ing  assessment  data,  school  improvement  planning,  implementing  effective  instruc¬ 
tional  strategies,  and  helping  to  teach  grade-level  standards  to  ELLs  and  to  student 
with  disabilities.  This  technical  assistance  was  generally  offered  to  all  schools,  not  just 
those  that  were  low  performing  (see  Tables  B.31  and  B.32). 

Superintendents  also  reported  that  districts  intervened  and  required  schools 
to  take  certain  actions  to  improve  student  performance.  For  example,  in  2006  over 
80  percent  of  districts  required  some  or  all  elementary  schools  to  offer  remedial 
assistance  to  students  outside  the  normal  school  day,  and  three-quarters  required 
the  same  of  middle  schools  (2005  responses  were  similar).  Similarly,  in  2005  and 
2006,  about  90  percent  of  districts  required  middle  schools  to  increase  the  amount 
of  instruction  that  low-achieving  students  received  in  mathematics  and  about  one- 
third  required  increased  time  for  low-achieving  students  in  science.  The  proportion 
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We  did  not  ask  this  question  in  2004. 
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of  districts  that  required  elementary  schools  to  increase  the  amount  of  mathemat¬ 
ics  instruction  for  low-achieving  students  decreased  dramatically  from  almost  all 
in  2005  to  just  half  in  2006,  while  the  proportion  of  districts  requiring  elementary 
schools  to  increase  science  instruction  remained  steady  at  about  one-third.  In  addi¬ 
tion,  a  small  but  growing  percentage  of  districts  required  middle  schools  to  imple¬ 
ment  new  mathematics  or  science  curricula.  From  2004  to  2006,  the  percentage  of 
districts  requiring  middle  schools  to  implement  new  curricula  grew  from  fewer  than 
20  percent  to  more  than  40  percent  in  mathematics  and  from  fewer  than  10  percent 
to  more  than  30  percent  in  science.  About  one-third  of  districts  required  elementary 
schools  to  implement  new  math  curricula  each  year,  and  a  smaller  proportion  required 
elementary  schools  to  implement  new  science  curricula  (see  Tables  B.33  to  B.35). 

There  were  only  21  schools  identified  for  improvement  in  our  2006  sample,  so  our 
estimates  for  identified  schools  are  not  as  precise  as  our  estimates  for  all  schools.  How¬ 
ever,  in  these  schools  the  most  common  forms  of  district  or  state  assistance  were  addi¬ 
tional  PD  resources,  special  grants  to  support  school  improvement,  a  mentor  or  coach 
for  the  principal  (e.g.,  a  distinguished  educator),  or  a  school  support  team.  There  were 
only  five  schools  in  corrective  action  in  our  2006  sample  (see  Tables  B.36  and  B.37). 

PD  emphasized  the  alignment  of  curriculum  and  instruction  with  standards  as 
well  as  other  improvement  strategies.  In  2004,  two-thirds  of  teachers  reported  that  a 
major  emphasis  of  the  PD  they  received  was  on  aligning  curriculum  and  instruction 
with  standards,  and  this  percentage  rose  to  over  three-quarters  by  2006.  One-half  or 
more  of  teachers  each  year  reported  that  the  following  topics  received  strong  empha¬ 
sis:  instructional  strategies  for  low- achieving  students,  preparing  students  to  take  state 
assessments,  and  mathematics  and  mathematics  teaching.  Slightly  more  than  half  of 
teachers  said  that  PD  had  a  major  focus  on  interpreting  and  using  student  test  results 
in  2006,  a  slight  increase  from  2004  (see  Table  B.38). 

Districts  reported  that  the  state  met  their  current  needs for  technical  assistance.  In  2005 
and  2006,  70  to  80  percent  of  districts  reported  that  they  needed  technical  assistance 
for  each  of  the  following  purposes:  identifying  effective  instructional  methods  and 
strategies,  providing  effective  PD,  and  using  data  more  effectively.5  Almost  all  superin¬ 
tendents  reported  that  they  received  the  technical  assistance  they  needed  in  these  areas 
in  2005  and  2006.  Similarly,  most  to  all  districts  reported  that  they  received  the  tech¬ 
nical  assistance  they  needed  in  most  other  areas  (e.g.,  clarifying  accountability  system 
rules  and  requirements,  developing  and  implementing  a  district  improvement  plan, 
and  working  with  schools  in  need  of  improvement).  Districts  were  less  likely  to  receive 
technical  assistance  in  promoting  parent  involvement;  just  over  half  of  superintendents 
who  needed  assistance  in  this  area  received  it  in  each  year.  Districts  in  Georgia  were 
generally  more  likely  than  districts  in  the  other  two  states  to  report  receiving  sufficient 
technical  assistance  from  the  state  (see  Table  B  .39). 


5  We  did  not  ask  this  question  in  2004. 
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What  Was  the  Impact  of  Accountability  on  Curriculum,  Teacher  Practice,  and 
Student  Learning? 

Educators’  reports  about  the  effects  of  accountability  on  curriculum  and  instruction  grew 
more  positive  from  2004  to  2006,  although  a  minority  of  teachers  continued  to  believe  that 
the  accountability  system  was  having  a  negative  effect  on  morale.  The  proportion  of  prin¬ 
cipals  who  agreed  that  the  academic  rigor  of  the  curriculum  had  changed  for  the  better 
grew  from  just  over  one-half  to  about  three-quarters  from  2004  to  2006.  During  the 
same  period,  the  proportion  of  teachers  agreeing  with  this  statement  grew  from  about 
40  percent  to  about  half.  Figure  3.4  shows  the  percentage  of  educators  who  reported 
that  the  academic  rigor  of  the  curriculum  improved.  (The  increases  were  not  statisti¬ 
cally  significant  in  the  case  of  superintendents  and  elementary  school  principals).  Few 
principals  or  teachers  reported  that  academic  rigor  had  changed  for  the  worse.  Positive 
results  were  found  regarding  the  school’s  focus  on  student  learning,  as  well.  Growing 
majorities  of  principals  (from  about  70  percent  in  2004  to  about  85  percent  in  2006)  and 
teachers  (from  about  half  in  2004  to  about  60  percent  in  2006)  reported  an  improved 
focus  on  student  learning  as  a  result  of  accountability.  There  were  also  small  increases 
during  this  period  in  the  proportion  of  educators  reporting  that  the  accountability 

Figure  3.4 

Georgia  Educators  Agreeing  That  the  Academic  Rigor  of  the  Curriculum  Had  Improved  as  a 
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system  was  beneficial  for  students  (from  slightly  fewer  than  half  to  slightly  more  than 
half  among  teachers  and  from  about  two-thirds  to  over  three-quarters  among  princi¬ 
pals)  (see  Tables  B.40  and  B.41). 

Each  year,  slightly  more  than  half  of  teachers  reported  that  their  teaching  prac¬ 
tices  had  improved  as  a  result  of  the  accountability  system,  and  over  one-quarter  said 
their  relations  with  their  students  had  improved,  as  well.  Over  two-thirds  of  teachers 
reported  that,  as  a  result  of  the  state  test,  they  searched  for  more-effective  teaching 
methods.  Each  year,  70  to  80  percent  of  middle  school  teachers  said  they  offered  more 
assistance  outside  of  the  school  day  to  students  who  were  not  proficient  as  a  result  of 
the  test-based  accountability  system,  compared  with  15  percent  of  elementary  science 
teachers  and  about  one-third  of  elementary  mathematics  teachers  (see  Tables  B.42  to 
B.44). 

In  2006,  the  majority  of  superintendents  and  principals  reported  that  coordina¬ 
tion  of  the  mathematics  and  science  curricula  across  grades  had  changed  for  the  better 
as  a  result  of  accountability,  representing  a  marked  increase  from  2004  among  super¬ 
intendents.  In  contrast,  about  half  of  teachers  reported  in  2004  that  staff  morale  had 
changed  for  the  worse  as  a  result  of  the  accountability  system;  that  percentage  had 
declined  to  about  40  percent  by  2006  (see  Figure  3.5  and  Tables  B.45  and  B.46). 

Figure  3.5 

Georgia  Educators  Agreeing  That  Staff  Morale  Had  Changed  for  the  Worse  as  a  Result  of 
Accountability 
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Teachers  responded  to  standards-based  accountability  by  aligning  their  curriculum 
with  standards  and  assessments  but  did  not  report  changing  specific  teaching  techniques. 
Teachers  reported  making  a  lot  of  changes  in  curriculum  and  instruction  in  response  to 
SBA.  Perhaps  the  most  widespread  change  involved  aligning  curriculum  and  instruc¬ 
tion  with  standards  and  assessments.  Each  year,  over  80  percent  of  teachers  reported 
that  they  had  aligned  their  instruction  with  the  standards,  and  about  80  percent  also 
reported  aligning  instruction  with  the  state  assessments  (see  Table  B.47). 

The  state  tests  were  an  explicit  factor  in  teachers’  reported  changes  in  practice. 
Each  year,  most  elementary  school  teachers  reported  that  the  state  assessments  caused 
them  to  focus  more  on  standards,  focus  more  on  topics  emphasized  in  the  assessment, 
and  place  more  emphasis  on  question  styles  and  formats  from  the  test.  Middle  school 
teachers  were  less  likely  to  report  that  the  state  assessment  caused  them  to  focus  more 
on  assessment  topics  (just  under  half  each  year)  and  place  more  emphasis  on  assessment 
question  styles  and  formats  (just  over  half  each  year)  (see  Tables  B.43  and  B.44). 

It  appears  that  teachers’  efforts  to  improve  alignment  did  not  typically  involve 
changing  the  amount  of  time  devoted  to  specific  subjects,  at  least  during  the  time 
period  we  studied.  Each  year,  over  60  percent  of  elementary  school  teachers  and  about 
half  of  middle  school  teachers  reported  no  change  in  the  amount  of  time  students 
were  exposed  to  each  subject  (math,  science,  reading/language  arts,  social  studies,  arts/ 
music,  and  physical  education).  Only  about  20  percent  of  teachers  reported  increases 
in  the  time  spent  on  mathematics  or  reading/language  arts,  and  there  were  few  reports 
of  decreases  in  time  on  these  two  subjects.  However,  small  but  consistent  minorities  of 
teachers,  particularly  elementary  school  teachers  (usually  between  10  and  15  percent), 
indicated  that  they  decreased  the  amount  of  time  they  spent  on  arts/music,  social  stud¬ 
ies,  or  science.  We  asked  teachers  about  changes  during  the  past  year  in  the  amount  of 
time  allocated  to  subjects.6  As  a  result,  we  cannot  estimate  cumulative  changes  since 
the  enactment  of  NCLB.  It  is  possible  that  these  findings  underestimate  the  cumula¬ 
tive  amount  of  time  reallocated  among  subjects  as  a  result  of  NCLB’s  accountability 
provisions  (see  Tables  B.48  and  B.49). 

In  general,  elementary  and  middle  school  mathematics  and  science  teachers’  reports 
about  particular  teaching  techniques  were  similar  and  did  not  change  much  from  2005 
to  2006.  Almost  all  mathematics  and  science  teachers  reported  that  they  sometimes 
or  often  used  most  of  the  techniques  included  in  our  survey,  including  introducing 
content  through  formal  presentations  or  direct  instruction,  assigning  homework,  and 
having  students  help  other  students  learn  content.  In  contrast,  only  about  one-half  of 
elementary  school  mathematics  teachers  and  one-third  of  middle  school  mathemat¬ 
ics  teachers  reported  having  students  work  on  extended  mathematics  investigations  or 


6  In  addition,  we  did  not  track  individual  teacher  responses  over  time,  so  we  cannot  combine  reported  annual 
changes  across  the  three  years  to  estimate  cumulative  change. 
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projects,  but  over  80  percent  of  science  teachers  reported  having  students  do  hands-on 
laboratory  science  activities  or  investigations  (see  Tables  B.50  to  B.53). 

About  half  of  teachers  were  concerned  that  the  focus  on  test  scores  deprived  high- 
achieving  students  of  challenging  curriculum.  About  one-half  of  teachers  reported  in  2005 
and  2006  that  high- achieving  students  were  not  receiving  an  appropriately  challeng¬ 
ing  curriculum  as  a  result  of  the  accountability  system.7  Other  survey  responses  offer 
possible  explanations  for  this  concern.  Each  year,  over  80  percent  of  teachers  felt  that 
the  accountability  system  left  little  time  to  teach  material  that  is  not  on  the  state  test. 
This  can  be  viewed  as  a  positive  outcome  given  that  SBA  is  designed  to  ensure  that  stu¬ 
dents  master  the  content  outlined  in  state  standards  and  measured  by  the  assessments. 
However,  this  narrow  focus  on  the  standards  may  exclude  teaching  advanced  material 
that  could  benefit  high- achieving  students.  We  also  found  evidence  that  some  teachers 
were  giving  special  attention  to  certain  groups  of  students.  Substantial  minorities  of 
teachers  (typically  between  30  and  40  percent)  said  the  state  tests  caused  them  to  focus 
more  on  students  near  the  proficient  level  (bubble  kids)  than  they  would  have  absent 
the  test  (perhaps  at  the  expense  of  students  farther  to  the  extremes  of  the  achievement 
spectrum),  and  there  were  small  increases  in  these  percentages  between  2004  and  2006 
among  elementary  school  teachers  (Tables  B.54,  B.43,  and  B.44). 

What  Conditions  Hindered  Improvement  Efforts? 

Inadequate  funding,  inadequate  materials,  and  insufficient  time  were  reported  to  hinder 
efforts  to  improve  performance.  Resources  are  always  a  concern  in  education,  and  each 
year  over  80  percent  of  superintendents  reported  that  lack  of  adequate  funding  was  a 
moderate  to  great  hindrance  to  their  improvement  efforts.  A  declining  proportion  of 
principals  concurred;  by  2006,  only  about  45  percent  of  elementary  school  principals 
and  about  60  percent  of  middle  schools  principals  reported  that  inadequate  funding 
was  a  hindrance  (each  was  down  from  about  three-quarters  in  2004).  The  propor¬ 
tion  of  administrators  reporting  that  inadequate  facilities  interfered  with  improvement 
efforts  also  declined,  from  over  20  percent  to  about  10  percent  of  principals  and  from 
30  percent  to  only  about  5  percent  of  superintendents.  About  40  percent  of  superinten¬ 
dents  said  shortages  of  standards-based  curriculum  materials  were  a  problem  in  2006, 
similar  to  previous  years.  Superintendents’  judgments  were  confirmed  by  teachers;  each 
year,  approximately  one-third  of  teachers  reported  that  inadequate  instructional  mate¬ 
rials  hindered  students’  academic  success  (see  Tables  B.55  and  B.56). 

Shortages  of  time  for  planning,  administration,  and  instruction  were  also  reported 
to  hinder  improvement  efforts.  In  2006,  about  two-thirds  of  principals  reported  that 
they  had  insufficient  staff  time  to  perform  their  administrative  duties,  an  increase  from 
about  half  in  2005. 8  Each  year,  about  one-half  of  teachers  reported  that  there  was 


7  We  did  not  ask  this  question  in  2004. 

8  We  did  not  ask  this  question  in  2004. 
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insufficient  class  time  to  cover  the  curriculum,  and  about  40  percent  reported  that 
there  was  inadequate  planning  time  built  into  the  school  day.  In  both  cases,  elementary 
school  teachers  were  more  likely  to  be  concerned  about  time  than  were  middle  school 
teachers.  Responses  from  principals  were  similar;  in  2005  and  2006,  about  20  per¬ 
cent  of  middle  school  principals  and  about  40  percent  of  elementary  school  principals 
reported  that  lack  of  teacher  planning  time  was  a  hindrance  to  school  improvement9 
(see  Tables  B.57  to  B.59). 

Teachers  reported  that  large  class  sizes  and  a  wide  range  of  student  abilities  in  class 
were  hindrances  to  student  academic  success.  Each  year,  about  two-thirds  of  teachers 
reported  that  the  wide  range  of  student  abilities  they  had  to  address  in  class  was  a  hin¬ 
drance  to  students’  academic  success.  Similarly,  each  year  slightly  more  than  one-half 
of  middle  school  teachers  and  slightly  less  than  one-half  of  elementary  school  teachers 
reported  that  large  class  sizes  hindered  students’  academic  success  (see  Tables  B.60  and 
B.56). 

Most  superintendents  reported  that  districts  had  adequate  capacity  to  support  school 
improvement.  Each  year,  two-thirds  or  more  of  superintendents  reported  that  their 
districts  had  adequate  staff  capacity  to  provide  schools  support  in  most  areas  we  stud¬ 
ied,  including  facilitating  improvement  in  low-performing  schools  and  helping  schools 
analyze  data  for  school  improvement.  The  proportion  of  superintendents  reporting  that 
they  had  adequate  capacity  to  conduct  PD  for  teachers  and  principals  increased  from 
about  one-third  in  2004  to  about  two-thirds  in  2006  (see  Table  B.61). 

A  minority  of  districts  and  schools  were  hindered  by  shortages  of  highly  qualified  prin¬ 
cipals,  highly  qualified  mathematics  and  science  teachers,  and  high-quality  PD  opportuni¬ 
ties  for  principals  and  teachers.  Each  year,  over  one-quarter  of  superintendents  reported 
a  lack  of  qualified  principals.  According  to  superintendents,  shortages  of  qualified 
mathematics  and  science  teachers  hindered  efforts  to  improve  performance  in  about 
two-thirds  to  three-quarters  of  districts  each  year.  Across  the  three  years,  a  substantial 
minority  of  superintendents  (between  15  percent  and  45  percent)  reported  that  their 
improvement  efforts  were  also  hindered  by  shortages  of  high-quality  PD  opportunities 
for  principals  or  teachers;  principals  cited  this  concern  in  smaller  proportions.  Shortages 
of  qualified  aides  or  paraprofessionals  were  a  less  frequently  reported  problem  (fewer  than 
20  percent  of  principals  identified  this  as  a  hindrance  each  year)  (see  Table  B.57). 

Most  teachers  reported  that  students’  lack  of  basic  skills  and  lack  of  parental  support 
impeded  their  efforts  to  improve  student  achievement.  Each  year,  about  70  percent  of 
elementary  school  teachers  and  over  80  percent  of  middle  school  teachers  reported  that 
their  efforts  to  improve  student  achievement  were  hindered  by  students’  inadequate 
basic  skills  or  prior  preparation.  Similar  percentages  of  teachers  reported  that  they  were 
hindered  in  their  efforts  to  improve  student  performance  by  lack  of  support  from  par¬ 
ents.  In  2006,  most  elementary  school  and  middle  school  teachers  reported  that  inade- 


9  We  did  not  ask  this  question  in  2004. 
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quate  basic  skills  or  prior  preparation  and  lack  of  support  from  parents  were  hindrances 
to  students’  academic  success  (see  Figure  3.6).  Student  absenteeism  and  tardiness  were 
concerns  for  one-half  of  elementary  school  teachers  and  two-thirds  to  three-quarters  of 
middle  school  teachers  (see  Table  B.60). 

Administrators  reported  that  changes  in  state  policies  and  state  leadership  were  imped¬ 
iments  to  improvement  in  many  districts  and  schools.  Each  year,  most  superintendents 
said  frequent  changes  in  state  policy  or  leadership  were  hindrances  to  improvement. 
In  2006,  one-third  of  superintendents  reported  that  disagreements  with  their  school 
boards  over  policies  hindered  their  improvement  efforts,  more  than  twice  the  propor¬ 
tion  in  2004.  However,  in  contrast  to  the  other  states  we  studied,  but  as  we  would 
expect  in  a  state  with  few  teacher  unions,  few  Georgia  superintendents  reported  that 
complying  with  teacher  association  rules  or  policies  hindered  their  improvement  efforts. 
Each  year,  fewer  than  20  percent  of  principals  said  frequent  changes  in  district  policy 
or  district  leadership  hindered  their  improvement  efforts  (see  Table  B.62). 

Some  principals  reported  that  a  lack  of  guidance  for  teaching  special-needs  popu¬ 
lations  was  a  hindrance  to  their  school  improvement  efforts.  In  2005  and  2006,  15 
to  30  percent  of  elementary  school  principals  and  20  to  40  percent  of  middle 
school  principals  reported  that  a  lack  of  guidance  for  teaching  standards  to  special 

Figure  3.6 

Georgia  Teachers  Reporting  That  Selected  Conditions  Were  Moderate  or  Great  Hindrances 
to  Students'  Academic  Success 


Percentage 
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education  students  was  a  moderate  or  great  hindrance  to  their  school  improvement 
efforts.  About  20  percent  of  elementary  school  principals  and  between  20  and  30  per¬ 
cent  of  middle  school  principals  reported  the  same  concern  in  reference  to  ELLs  (see 
Table  B.63). 


CHAPTER  FOUR 


Implementation  of  SBA  in  Pennsylvania 


Background  on  Pennsylvania's  SBA  System 

Of  the  three  states  in  the  ISBA  study,  Pennsylvania  had  the  least  developed  SBA  system 
prior  to  NCLB.  Pennsylvania  has  a  tradition  of  local  control  in  education,  with  mini¬ 
mal  interference  from  the  state.  Prior  to  NCLB,  Pennsylvania  had  content  standards 
and  testing  for  reading  and  math  in  grades  three,  five,  eight,  and  eleven,  and  science 
standards  in  grades  four,  seven,  ten,  and  twelve.  The  Pennsylvania  State  Board  of  Edu¬ 
cation  academic  standards  were  cumulative,  describing  what  students  should  know  by 
the  end  of  the  grade,  including  material  learned  in  earlier  grades.  However,  the  stan¬ 
dards  were  not  designed  to  indicate  what  material  would  be  assessed  on  the  Pennsylva¬ 
nia  System  of  School  Assessment  (PSSA).  Despite  its  tradition  of  local  control,  the  state 
was  starting  to  play  a  somewhat  larger  role  in  education  prior  to  NCLB.  For  example, 
in  2000,  the  Pennsylvania  General  Assembly  passed  the  Education  Empowerment  Act 
(Article  XVII-B),  which  allowed  the  state  to  identify  low-performing  districts  as  educa¬ 
tion  empowerment  districts.  Once  districts  were  labeled  as  empowerment  districts,  the 
state  gave  local  boards  of  education  expanded  powers  to  improve  schools  by  reopening 
them  as  charters  schools,  reconstituting  them,  or  restructuring  them  in  other  major 
ways. 

NCLB  forced  Pennsylvania  to  make  a  number  of  changes  to  its  education  system. 
The  content  standards  were  revised  to  include  new  “assessment  anchors,”  which  describe 
what  material  is  assessed  at  each  grade  level.  Starting  in  2006,  students  were  tested  in 
math  and  reading  in  all  grades  from  three  to  eight  as  well  as  in  grade  eleven;  in  the 
2007-2008  school  year,  science  testing  was  added  for  grades  four,  eight,  and  eleven.  In 
2004,  Pennsylvania  created  the  Pennsylvania  Performance  Index  (PPI),  which  is  a  con¬ 
tinuous  improvement  measure  that  is  based  on  improvements  at  all  levels  of  the  PSSA. 
Pennsylvania  allowed  schools  to  appeal  their  AYP  status  by  demonstrating  significant 
growth  on  PPI.  PPI  was  approved  by  the  U.S.  Department  of  Education  in  2005  as  an 
alternate  AYP  measure.  If  a  school  fails  to  meet  its  AMO  targets  for  its  student  body  in 
total  and  its  subgroups,  it  can  still  meet  AYP  by  hitting  a  target  on  PPI. 

According  to  NCES,  Pennsylvania’s  eighth  grade  assessment  in  math  falls  in  the 
middle  of  a  spectrum  of  states  in  terms  of  difficulty,  well  above  Georgia’s  (NCES, 
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2007)  (California  was  not  one  of  the  states  in  the  eighth  grade  math  comparison). 
Pennsylvania’s  eighth  grade  reading  test  seems  to  be  quite  rigorous  compared  with  that 
of  other  states,  just  below  California’s  test  in  difficulty  but  far  above  Georgia’s  test.  The 
proficient  levels  on  both  exams  correspond  to  NAEP  scores  between  basic  and  profi¬ 
cient.  Consistent  with  this  evidence,  Pennsylvania’s  AMO  starting  points  in  reading 
(45  percent)  and  math  (35  percent)  fall  between  California’s  and  Georgia’s  (see  Figures 
2.1  and  2.2).  Pennsylvania’s  AMO  trajectory  follows  the  same  step  pattern  as  Georgia’s, 
but  its  trajectory  is  necessarily  steeper  given  its  lower  AMO  starting  points.  As  with  the 
other  states  in  our  study,  Pennsylvania’s  AMO  target  increased  during  the  middle  year 
of  our  data  collection  but  not  in  the  other  years  we  collected  data. 

In  2004-2005  and  2005-2006,  Pennsylvania  had  roughly  the  same  percentage  of 
schools  fail  to  make  AYP  as  Georgia  (about  20  percent).  However,  as  noted  earlier,  Penn¬ 
sylvania  had  fewer  schools  in  improvement  status  than  did  Georgia  (see  Table  2.1). 


Pennsylvania  Findings  from  the  ISBA  Study 

How  Did  Districts,  Schools,  and  Teachers  Respond  to  State  Accountability  Efforts, 
Including  State  Standards  and  State  Tests? 

Pennsylvania  mathematics  and  science  standards  were  perceived  to  be  useful,  but  local  cur¬ 
riculum  was  not  always  aligned  with  standards.  Each  year,  about  three-quarters  of  Penn¬ 
sylvania  mathematics  teachers  reported  that  the  state  standards  were  useful  for  plan¬ 
ning  their  lessons  (a  somewhat  smaller  majority  than  in  the  other  states  we  studied).1  In 
comparison,  only  slightly  more  than  one-half  of  Pennsylvania  science  teachers  reported 
that  the  state  standards  were  useful  for  planning  their  lessons  in  2006,  but  this  marked 
a  10  percentage-point  increase  from  2004.  Although  useful,  the  standards  were  per¬ 
ceived  by  many  teachers  as  being  too  broad.  In  2006,  about  two-thirds  of  mathemat¬ 
ics  and  science  teachers  reported  that  the  state  standards  included  more  content  than 
could  be  adequately  covered  in  a  school  year.  This  percentage  had  decreased  among 
elementary  mathematics  teachers  and  increased  among  elementary  science  teach¬ 
ers  from  2004  to  2006,  suggesting  growing  comfort  with  the  scope  of  elementary 
mathematics  standards  but  not  with  the  science  standards.  At  the  same  time,  about 
one-quarter  of  science  teachers  and  a  growing  minority  of  mathematics  teachers  (from 
about  15  percent  in  2004  to  about  one-quarter  in  2006)  reported  that  the  standards 
omitted  important  topics  that  were  part  of  their  curriculum.  Figure  4.1  shows  that 
despite  the  fact  that  a  majority  of  teachers  found  the  standards  useful,  many  teachers 
had  concerns  about  the  alignment  of  standards  to  their  curriculum.  Thus,  in  teachers’ 
judgments,  the  standards  may  embody  unrealistic  expectations  for  how  much  content 


1  The  surveys  administered  in  Pennsylvania  asked  about  the  “state  standards  and  assessment  anchors,”  which 
were  considered  part  of  the  standards  in  that  state. 


Implementation  of  SBA  in  Pennsylvania  49 


Figure  4.1 

Pennsylvania  Teachers  Agreeing  with  Statements  About  State  Content  Standards,  2006 
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can  be  covered,  and  there  remains  some  misalignment  between  the  content  of  the 
mathematics  and  science  standards  and  the  content  of  their  curricula  (see  Tables  B.l 
and  B.2). 

A  majority  of  educators  did  not  believe  that  Pennsylvania  mathematics  and  science 
assessments  were  good  measures  of  student  achievement.  Administrators  and  teachers  had 
mixed  opinions  about  the  quality  of  the  state  assessments.  Each  year,  less  than  one-half 
of  superintendents  and  middle  school  principals  and  just  over  one-half  of  elementary 
school  principals  thought  that  state  assessments  accurately  reflected  student  achieve¬ 
ment.  These  responses  were  generally  lower  than  in  the  other  states  we  studied.  Similarly, 
in  2006  slightly  fewer  than  half  of  mathematics  teachers  reported  that  the  assessments 
were  a  good  measure  of  students’  mastery  of  content  standards  (although  the  percent¬ 
age  had  increased  from  2004  among  elementary  school  teachers).  Figure  4.2  shows  that 
a  majority  of  elementary  school  principals  saw  state  assessments  as  valid  indicators  of 
student  achievement  but  fewer  middle  school  principals  and  teachers  agreed.  Further¬ 
more,  in  2006,  about  40  percent  of  elementary  mathematics  teachers  and  about  three- 
quarters  of  middle  school  mathematics  teachers  reported  that  the  mathematics  assess¬ 
ments  were  too  difficult  for  their  students,  although  these  percentages  had  declined  by  15 
to  20  percentage  points  from  2004.  Despite  the  introduction  of  the  assessment  anchors 
in  the  spring  of  2004  for  mathematics  and  reading,  a  substantial,  although  declin¬ 
ing,  minority  of  elementary  mathematics  teachers  (from  one-third  in  2004  to  under 
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Figure  4.2 

Pennsylvania  Educators  Agreeing  That  States  Assessment  Scores  Accurately  Reflect  Student 
Achievement  (Principals)  or  Are  Good  Measures  of  Student  Mastery  (Teachers) 
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20  percent  in  2006)  and  over  one-third  of  middle  school  mathematics  teachers  reported 
that  the  state  tests  included  content  not  in  their  curriculum,  and  similar  percentages 
reported  that  the  tests  omitted  content  that  was  in  their  curriculum.  As  was  the  case 
with  standards,  some  teachers  perceive  there  to  be  misalignment  between  the  content 
of  the  state  assessments  and  the  content  of  the  local  curriculum  (see  Tables  B.3  and 
B.4). 

Test  results  were  widely  available  in  a  variety  of  formats,  but  they  were  not  always 
available  in  a  timely  manner.  Each  year,  almost  all  elementary  school  principals  and 
over  80  percent  of  middle  school  principals  reported  that  test  results  for  the  school  as  a 
whole,  for  student  subgroups,  and  for  content  subtopics  were  available  to  them.  Simi¬ 
larly,  about  80  percent  of  mathematics  teachers  reported  that  test  results  were  avail¬ 
able  to  them  by  subgroup  and  by  subtopic  each  year.  However,  educators  gave  mixed 
responses  about  the  timeliness  of  test  reporting.  Fewer  than  one-quarter  of  principals 
reported  receiving  results  in  a  timely  manner  in  2006  (similar  to  responses  in  previous 
years).  The  percentage  of  teachers  reporting  timely  receipt  of  test  reports  declined  from 
about  two-thirds  in  2004  to  about  one-half  in  2006  (see  Tables  B.6  to  B.10). 

Test  results  were  widely  used  by  superintendents  and  principals,  but  teachers’  reports 
of  usefulness  decreased from  2004  to  2006.  Each  year,  two-thirds  or  more  of  superinten¬ 
dents  reported  that  assessment  results  were  helpful  for  each  of  the  following  purposes: 
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district  and  school  planning,  focusing  PD,  and  curriculum  reform.  Similarly,  two- 
thirds  or  more  of  principals  said  they  found  the  test  results  useful  for  planning  school 
improvement,  focusing  PD,  reforming  curriculum,  and  identifying  students  who  need 
extra  support.  However,  one-third  or  fewer  of  principals  reported  that  the  data  were 
useful  for  making  decisions  regarding  student  promotion  and  retention  and  for  identi¬ 
fying  teachers’  strengths  and  weaknesses  (far  fewer  than  in  the  other  states  we  studied) 
(see  Tables  B.ll  and  B.12). 

In  2006,  about  60  percent  of  mathematics  teachers  said  the  test  results  were  useful 
for  identifying  gaps  in  curriculum  and  instruction  and  for  identifying  areas  where  they 
needed  to  strengthen  their  content  knowledge  or  teaching  skills,  down  from  about 
three-quarters  in  2004.  About  40  percent  of  mathematics  teachers  reported  that  the 
results  were  useful  for  tailoring  instruction  to  individual  student  needs.  Each  year,  just 
under  one-third  of  the  mathematics  teachers  said  the  subgroup  results  were  useful  to 
them,  while  about  two-thirds  of  the  mathematics  teachers  said  the  subtopic  results 
were  useful  to  them  (see  Tables  B.13,  B.8,  and  B.9). 

Superintendents  increasingly  promoted  the  use  of  periodic  progress  tests*  2  in  addition 
to  the  annual  state  test,  and  teachers  found  progress  test  results  helpful for  improving  teach¬ 
ing  and  learning  In  2005  and  2006,  between  one-third  and  two-thirds  of  superinten¬ 
dents  reported  that  their  districts  required  some  or  all  elementary  and  middle  schools 
to  administer  periodic  progress  tests  to  monitor  student  learning  in  mathematics;  few 
superintendents  required  progress  testing  in  science.3  Progress  test  requirements  in  sci¬ 
ence  were  less  common  in  Pennsylvania  than  in  either  of  the  two  other  states  we  stud¬ 
ied,  which  is  consistent  with  the  fact  that  state  testing  in  science  was  implemented 
later  in  Pennsylvania.  Progress  tests  were  typically  administered  either  two  to  three 
times  per  year  or  every  six  to  eight  weeks,  with  a  smaller  number  of  teachers  reporting 
more  frequent  testing.  According  to  teachers,  the  use  of  progress  tests  in  mathematics 
increased  from  2004  to  2006;  in  2006,  over  half  of  teachers  reported  that  they  were 
required  to  administer  progress  tests,  up  from  about  30  percent  of  teachers  in  2004. 
Each  year,  about  70  percent  of  teachers  in  schools  that  used  progress  tests  reported 
that  the  progress  test  was  a  good  measure  of  student  mastery,  and  over  80  percent 
reported  that  the  progress  tests  helped  them  identify  and  correct  gaps  in  curriculum 
and  instruction  (both  percentages  are  generally  higher  than  the  responses  to  compa¬ 
rable  questions  regarding  the  annual  state  tests)  (see  Tables  B.14  to  B.18).  Figure  4.3 
shows  that  a  majority  of  teachers  found  both  annual  state  tests  and  progress  tests  useful 
for  identifying  and  correcting  gaps  in  curriculum,  but  the  percentage  of  elementary 
school  and  middle  school  teachers  who  found  state  tests  useful  for  this  purpose  was 


-  Progress  tests  are  formal  assessments  given  periodically  during  the  year  to  measure  student  progress  in  master¬ 

ing  state  standards.  They  are  also  called  interim  tests,  formative  tests,  and  benchmark  tests.  To  our  knowledge, 
these  exams  do  not  result  in  any  consequences  for  teachers  in  the  districts  we  studied. 

3  We  did  not  ask  this  question  in  2004. 
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Figure  4.3 

Pennsylvania  Teachers  Agreeing  That  Annual  State  Tests  and  Progress  Tests  Are  Helpful  in 
Identifying  and  Correcting  Gaps  in  Curriculum  and  Instruction 
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decreasing  over  time,  and  the  percentage  of  middle  school  teachers  who  found  progress 
tests  useful  for  this  purpose  was  increasing  over  time. 

Pennsylvania  educators  reported  that  they  understood  the  state  accountability  system, 
but  not  all  agreed  that  AYP  status  was  a  good  reflection  of  their  students’  performance  or 
that  AYP  targets  would  be  attained  in  future  years.  Each  year,  almost  all  Pennsylvania 
administrators  reported  that  they  understood  the  AYP  criteria  being  used  in  the  state, 
and  80  percent  or  more  of  educators  reported  that  they  received  help  to  understand  all 
the  accountability  system  requirements.  On  the  other  hand,  a  substantial,  albeit  declin¬ 
ing,  proportion  of  teachers  reported  that  the  system  was  too  complicated  to  understand 
(slightly  more  than  half  in  2004  and  about  40  percent  in  2006).  In  2004,  only  about 
one-third  of  superintendents  and  principals  agreed  that  AYP  status  accurately  reflected 
the  overall  performance  of  their  students;  but  by  2006,  over  one-half  of  the  adminis¬ 
trators  agreed.  Principals  in  schools  that  made  AYP  were  more  likely  to  agree  that  AYP 
was  an  accurate  reflection  of  student  performance  than  principals  in  schools  that  did 
not.  Each  year,  a  majority  of  superintendents  and  middle  school  principals  and  almost 
all  elementary  school  principals  thought  their  schools  or  districts  would  make  AYP  the 
next  year,  but  one-half  or  fewer  believed  they  would  continue  to  make  AYP  over  the 
next  five  years  (see  Tables  B.19  to  B.23). 
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What  School  Improvement  Strategies  Were  Used,  and  Which  Were  Perceived  to  Be 
Most  Useful? 

School  improvement  efforts  incorporated  a  wide  repertoire  of  strategies.  Each  year,  seven  of 
the  strategies  to  improve  school  performance  were  reported  to  be  used  by  two-thirds 
or  more  of  principals,  including  matching  curriculum  and  instruction  with  standards 
and/or  assessments,  using  existing  research,  providing  additional  instruction  to  low- 
performing  students,  increasing  the  use  of  test  data,  increasing  teacher  PD,  improving 
the  school  planning  process,  and  providing  out-of-school  time  programs.  Less  preva¬ 
lent,  but  still  common,  were  efforts  to  make  the  school  more  attractive  to  parents  or  to 
restructure  the  school  day,  with  about  half  of  principals  reporting  each  of  these  strate¬ 
gies  each  year.  About  one-quarter  of  principals  reported  increasing  instructional  time 
by  lengthening  the  school  day  or  year  or  shortening  recess  (see  Table  B.24). 

Data  use,  alignment,  and  focusing  on  low-performing  students  were  the  most  impor¬ 
tant  school  improvement  strategies,  according  to  principals.  In  2005,  the  three  strate¬ 
gies  identified  as  most  important  by  the  largest  percentages  of  principals  were  increas¬ 
ing  the  use  of  achievement  data  to  inform  instruction  (about  one-half  of  elementary 
school  principals  and  one-third  of  middle  school  principals),  matching  curriculum  and 
instruction  with  standards  and/or  assessments  (about  60  percent  of  all  principals),  and 
providing  additional  instruction  to  low-performing  students  (about  one-half  of  ele¬ 
mentary  school  principals  and  one-third  of  middle  school  principals).  In  2006,  these 
three  strategies  continued  to  be  the  ones  reported  as  most  important  by  the  largest 
proportions  of  principals.  Between  2005  and  2006,  there  was  a  25  percentage-point 
increase  in  the  proportion  of  middle  schools  principals  who  identified  increasing  use 
of  achievement  data  as  one  of  their  three  most  important  improvement  strategies  (see 
Table  B.25). 

Pennsylvania  principals  reported  that  their  schools  and  districts  engaged  in  a  wide 
variety  of  test  preparation  activities.  Each  year,  almost  all  principals  reported  that  their 
schools  were  engaged  in  one  or  more  forms  of  test  preparation,  including  identifying 
content  that  is  likely  to  appear  on  the  state  test,  discussing  methods  for  preparing  stu¬ 
dents  to  take  tests,  and  distributing  released  copies  of  the  test  or  test  items.  In  addition, 
about  two-thirds  of  principals  reported  encouraging  teachers  to  focus  on  students  near 
the  proficient  level  (bubble  kids)  in  both  2005  and  2006  (see  Table  B.26). 

According  to  superintendents,  districts  provided  a  range  of  support  to  principals  and 
teachers  for  school  improvement.  In  2006,  over  60  percent  of  districts  implemented  each 
of  the  following  strategies  to  help  schools  align  curriculum  and  instruction  with  stan¬ 
dards  in  mathematics:  establishing  detailed  curriculum  guidelines  aligned  with  state 
content  standards,  mapping  the  alignment  of  textbooks  and  instructional  programs 
to  state  standards,  and  developing  “pacing  plans”  or  “instructional  calendars”  aligned 
with  standards.4  Generally  smaller  proportions  of  districts  made  similar  alignment 
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efforts  in  science.  Each  year,  about  80  percent  of  mathematics  teachers  reported  that 
the  district  actions  listed  above  were  useful  to  them  in  aligning  their  curriculum  (see 
Tables  B.27  to  B.30). 

Each  year,  over  60  percent  of  principals  reported  that  their  districts  provided 
needed  assistance  to  schools  when  they  were  having  difficulties,  appropriate  support  to 
enable  principals  to  act  as  instructional  leaders,  and  appropriate  instructional  support 
for  teachers.  In  2006,  about  90  percent  of  superintendents  reported  that  their  districts 
helped  some  or  all  schools  obtain  additional  PD  to  apply  the  results  of  scientifically 
based  research  about  education,  up  from  about  two-thirds  in  2004.  Each  year,  30  per¬ 
cent  or  more  of  superintendents  reported  assigning  additional  full-time  school-level 
staff  to  support  teacher  development  in  some  or  all  schools,  and  15  percent  or  more  pro¬ 
vided  a  coach  or  mentor  to  assist  the  principal  in  some  or  all  schools.  Also,  85  percent 
or  more  of  districts  helped  some  or  all  schools  analyze  assessment  data  to  identify  and 
address  problems  in  instruction.  Most  superintendents  reported  providing  guidance 
for  teaching  grade-level  standards  to  ELLs  and/or  special  education  students,  assisting 
schools  in  implementing  proven  instructional  strategies,  and  providing  before-  or  after- 
school,  weekend,  or  summer  programs.  Technical  assistance  was  typically  offered  to  all 
schools,  not  just  those  that  were  low  performing  (see  Tables  B.31  and  B.32). 

Superintendents  also  reported  that  districts  intervened  and  required  schools  to 
take  certain  actions  to  improve  student  performance.  For  example,  in  both  2005  and 
2006  almost  all  districts  required  some  or  all  elementary  schools  to  offer  remedial 
assistance  to  students  outside  the  normal  school  day,5  and  over  80  percent  required 
the  same  of  middle  schools.  Also  in  both  years,  about  one-half  of  districts  required 
schools  to  increase  the  amount  of  instruction  that  low- achieving  students  received  in 
mathematics,  but  few  required  increased  time  for  low- achieving  students  in  science.  In 
addition,  some  districts  required  schools  to  implement  a  new  mathematics  or  science 
curriculum.  Each  year,  about  one-third  of  districts  required  middle  schools  to  imple¬ 
ment  new  math  curricula,  and  about  one-third  required  elementary  schools  to  do  the 
same.  Similar  proportions  of  districts  required  their  schools  to  implement  new  science 
curricula  (see  Tables  B.33  to  B.35). 

In  2006,  there  were  only  nine  schools  (from  a  sample  of  97)  identified  for  improve¬ 
ment  in  our  sample,  so  our  estimates  of  responses  from  identified  schools  are  not  as 
precise  as  our  estimates  from  all  schools.  Elowever,  in  these  schools  the  most  common 
forms  of  district  or  state  assistance  were  additional  PD  resources  and  special  grants  to 
support  school  improvement.  There  were  only  four  schools  in  corrective  action  in  our 
sample  in  2006  (see  Tables  B.36  and  B.37). 

PD  emphasized  aligning  curriculum  and  instruction  with  standards,  as  well  as  other 
improvement  strategies.  Across  all  three  years,  about  60  percent  of  teachers  reported  that 
aligning  curriculum  and  instruction  with  standards  was  a  major  emphasis  of  the  PD 
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they  received.  Other  topics  that  received  strong  emphasis  from  more  than  one-half  of 
teachers  each  year  were  preparing  students  to  take  state  assessments,  and  mathemat¬ 
ics  and  mathematics  teaching.  About  40  percent  of  teachers  reported  an  emphasis  on 
instructional  strategies  for  low- achieving  students,  and  about  one-third  of  teachers  said 
that  PD  had  a  major  focus  on  interpreting  and  using  student  test  results  (see  Table 
B.38). 

Districts  that  reported  needing  technical  assistance  from  the  state  often  did  not  receive 
it.  In  2005  and  2006,  over  three-quarters  of  districts  reported  that  they  needed  techni¬ 
cal  assistance  to  identify  research-based  instructional  strategies,  provide  effective  PD, 
and  use  data  more  effectively.6  However,  only  about  40  to  60  percent  of  superinten¬ 
dents  who  needed  technical  assistance  in  these  areas  reported  that  they  received  the 
assistance  they  needed  (a  level  that  was  lower  than  in  the  other  states  we  studied). 
Similarly,  one-third  to  one-half  of  the  districts  that  needed  technical  assistance  in  other 
areas  in  2006  (e.g.,  clarifying  accountability  system  rules  and  requirements,  developing 
curriculum  guides  or  model  lessons,  promoting  parent  involvement,  or  working  with 
schools  in  need  of  improvement)  reported  that  they  received  it.  The  reported  receipt 
of  technical  assistance  to  develop  district  improvement  plans  dropped  from  about  70 
percent  in  2005  to  about  20  percent  in  2006  (see  Table  B.39). 

What  Was  the  Impact  of  Accountability  on  Curriculum,  Teacher  Practice,  and 
Student  Learning? 

Most  principals  thought  the  accountability  system  had  positive  effects  on  curriculum  and 
instruction,  but  teachers’  responses  were  not  as  positive.  Each  year,  more  than  half  of 
elementary  school  principals  but  slightly  fewer  than  half  of  middle  school  principals 
thought  the  academic  rigor  of  the  curriculum  had  improved  because  of  accountability. 
Teachers  were  less  sanguine  than  principals,  about  30  percent  reporting  that  academic 
rigor  had  changed  for  the  better,  and  about  20  percent  reporting  that  it  changed  for 
the  worse;  these  teacher  responses  were  more  negative  than  responses  from  teachers 
in  the  other  states  we  studied.  Figure  4.4  shows  that  in  each  year,  teachers  were  much 
less  likely  than  administrators  to  report  that  the  academic  rigor  of  the  curriculum  had 
improved.  Similarly,  in  2006  about  two-thirds  of  principals  reported  changes  for  the 
better  in  students’  learning  of  important  skills  and  knowledge,  but  fewer  than  one- 
third  of  teachers  agreed,  and  15  percent  of  middle  school  teachers  thought  changes 
had  been  for  the  worse.  These  percentages  represent  increases  from  2004,  in  particular 
among  middle  school  principals.  In  addition,  in  2006  over  two-thirds  of  principals 
reported  that  teachers’  focus  on  student  learning  had  changed  for  the  better  as  a  result 
of  the  state  accountability  system,  but  only  about  40  percent  of  teachers  concurred 
(responses  were  similar  in  2004).  In  fact,  in  2004,  over  15  percent  of  teachers  reported 
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Figure  4.4 

Pennsylvania  Educators  Agreeing  That  the  Academic  Rigor  of  the  Curriculum  Had  Improved 
as  a  Result  of  Accountability 
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that  the  focus  on  student  learning  had  actually  changed  for  the  worse  as  a  result  of  the 
accountability  system,  though  this  declined  to  fewer  than  10  percent  by  2006.  Overall, 
about  two-thirds  of  principals  but  less  than  one-third  of  teachers  reported  each  year 
that  the  state’s  accountability  system  was  beneficial  for  students  (see  Tables  B.40  and 
B.41). 

Each  year,  about  35  to  40  percent  of  teachers  reported  that  their  teaching  prac¬ 
tices  had  changed  for  the  better  as  a  result  of  the  accountability  system,  although  fewer 
than  20  percent  thought  their  relations  with  their  students  had  improved,  as  well. 
Sixty  percent  or  more  of  elementary  school  math  teachers  and  a  growing  majority  of 
middle  school  math  teachers  (from  just  over  half  in  2004  to  three-quarters  in  2006) 
reported  that  the  state  tests  had  led  them  to  search  for  more  effective  teaching  meth¬ 
ods.  Two-thirds  to  three-quarters  of  middle  schools  teachers  but  only  15  to  20  percent 
of  elementary  school  teachers  reported  that  they  offered  more  assistance  outside  of  the 
school  day  to  students  who  were  not  proficient  as  a  result  of  the  accountability  system 
(see  Tables  B.42  to  B.44). 

In  2006,  almost  all  superintendents  and  about  two-thirds  of  principals  reported 
that  coordination  of  the  mathematics  curricula  across  grades  had  changed  for  the  better 
as  a  result  of  accountability,  but  only  about  60  percent  of  superintendents  and  40  per¬ 
cent  of  principals  reported  improved  coordination  of  the  curricula  in  science  (these 
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percentages  represented  an  increase  from  2004  among  superintendents).  In  contrast, 
about  70  percent  of  teachers  reported  that  staff  morale  had  changed  for  the  worse  as 
a  result  of  the  accountability  system  in  2004,  although  that  percentage  had  declined 
slightly  to  about  60  percent  by  2006  (see  Figure  4.5  and  Tables  B.45  and  B.46). 

Teachers  responded  to  standards-based  accountability  by  aligning  their  curricula  and 
instruction  with  standards  and  assessments,  but  did  not  report  changing  specific  teaching 
techniques.  Teachers  reported  making  a  lot  of  changes  in  curricula  and  instruction 
in  response  to  standards-based  accountability.  Perhaps  the  most  widespread  change 
involved  aligning  curricula  and  instruction  with  standards  and  assessments.  Each 
year,  over  three-quarters  of  mathematics  teachers  reported  that  they  had  aligned  their 
instruction  with  the  standards,  and  over  80  percent  also  reported  aligning  instruction 
with  state  assessments  (see  Table  B.47). 

Teachers  reported  that  their  focus  on  alignment  was  due,  in  part,  to  the  test-based 
accountability  system.  Each  year,  about  three-quarters  of  elementary  school  math  teach¬ 
ers  and  over  half  of  middle  school  math  teachers  reported  that  they  focused  more  on 
standards  as  a  result  of  the  state  testing  program.  Over  70  percent  of  elementary  school 
math  teachers  and  just  under  half  of  middle  school  math  teachers  also  reported  that  as 
a  result  of  the  state  assessment,  they  focused  more  on  covered  topics  and  placed  more 
emphasis  on  question  styles  and  formats  from  the  test  (see  Tables  B.43  and  B.44). 

Figure  4.5 

Pennsylvania  Educators  Agreeing  That  Staff  Morale  Had  Changed  for  the  Worse  as  a  Result 
of  Accountability 
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It  appears  that  teachers’  efforts  to  improve  alignment  did  not  typically  involve 
changing  the  amount  of  time  devoted  to  specific  subjects.  Each  year,  over  60  percent 
of  teachers  reported  no  changes  in  the  amount  of  time  students  spent  on  each  of  the 
following  subjects:  mathematics,  reading/language  arts,  science,  social  studies,  arts  and 
music,  and  physical  education.  Only  about  one-quarter  to  one-third  of  elementary 
school  teachers  and  10  to  20  percent  of  middle  school  teachers  reported  increasing 
the  time  they  spent  on  mathematics  and  reading/language  arts  each  year,  and  few 
reported  decreasing  time  on  these  two  subjects,  ffowever,  about  one-quarter  of  elemen¬ 
tary  school  teachers  reported  decreasing  the  time  spent  on  science  or  social  studies  each 
year.  It  is  important  to  note  that  we  asked  teachers  about  changes  over  the  past  year  in 
the  amount  of  time  allocated  to  subjects.  As  a  result,  teachers’  responses  would  not  be 
expected  to  reflect  cumulative  changes  since  the  enactment  of  NCLB.  Thus,  it  is  possi¬ 
ble  that  these  findings  underestimate  the  amount  of  time  reallocated  between  subjects 
as  a  result  of  NCLB  accountability  provisions  (see  Tables  B.48  and  B.49). 

In  general,  elementary  and  middle  school  mathematics  and  science  teachers’ 
reports  about  particular  teaching  techniques  were  similar  from  2005  to  2006.  Almost 
all  mathematics  teachers  and  smaller  majorities  of  science  teachers  reported  that  they 
sometimes  or  often  used  each  of  the  following  techniques  included  in  the  survey:  intro¬ 
ducing  content  through  formal  presentations  or  direct  instruction,  assigning  home¬ 
work,  having  students  help  other  students  learn  content,  reteaching  topics  because 
performance  did  not  meet  expectations,  and  reviewing  assessment  results  to  identify 
individual  students  who  needed  supplemental  instruction  or  to  identify  topics  requir¬ 
ing  more  or  less  emphasis  in  instruction.  In  contrast,  fewer  than  one-half  of  mathemat¬ 
ics  teachers  reported  having  students  work  on  extended  mathematics  investigations  or 
projects,  but  over  three-quarters  of  science  teachers  reported  having  their  student  do 
hands-on  laboratory  activities  or  investigations  (see  Tables  B.50  to  B.53). 

About  half  of  teachers  were  concerned  that  the  strong  focus  on  test  scores  deprived  high- 
achieving  students  of  a  challenging  curriculum.  Slightly  more  than  one-half  of  middle 
school  teachers  and  slightly  less  than  one-half  of  elementary  school  teachers  reported  in 
2005  and  2006  that  high-achieving  students  were  not  receiving  an  appropriately  chal¬ 
lenging  curriculum  as  a  result  of  the  accountability  system.7  Other  survey  responses 
offer  possible  explanations  for  this  concern.  Each  year,  over  80  percent  of  teachers  felt 
that  the  accountability  system  left  little  time  to  teach  material  that  is  not  on  the  state 
test.  This  can  be  viewed  as  a  positive  outcome  given  that  SBA  is  designed  to  ensure  that 
students  master  the  content  outlined  in  state  standards  and  measured  by  the  assess¬ 
ments.  ffowever,  this  narrow  focus  on  the  standards  may  exclude  teaching  advanced 
material  that  could  benefit  high-achieving  students.  Each  year,  about  one-quarter  of 
mathematics  teachers  said  the  state  tests  caused  them  to  focus  more  on  students  near 
the  proficient  level  (bubble  kids)  than  they  would  have  absent  the  test  (perhaps  at  the 
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expense  of  students  farther  to  the  extremes  of  the  achievement  spectrum)  (see  Tables 
B.54,  B.43,  and  B.44). 

What  Conditions  Hindered  Improvement  Efforts? 

Inadequate  funding,  inadequate  materials,  and  insufficient  time  were  reported  to  binder 
efforts  to  improve  performance.  Resources  are  always  a  concern  in  education,  and  each 
year  over  80  percent  of  superintendents  reported  that  lack  of  adequate  funding  was 
a  moderate  to  great  hindrance  to  their  improvement  efforts.  Each  year  about  three- 
quarters  of  middle  school  principals  and  over  half  of  elementary  school  principals  con¬ 
curred.  School  facilities  were  less  of  a  concern;  in  2006,  fewer  than  20  percent  of 
superintendents  and  elementary  school  principals  (but  more  than  one-third  of  middle 
school  principals)  reported  that  inadequate  school  facilities  impeded  improvement 
efforts  (responses  were  similar  in  previous  years).  Thirty  percent  or  more  of  superinten¬ 
dents  said  shortages  of  standards-based  curriculum  materials  were  a  problem  each  year. 
Teachers  reported  similar  judgments;  one-quarter  to  one-third  of  teachers  reported 
that  inadequate  instructional  materials  hindered  students’  academic  success  each  year 
(see  Tables  B.55  and  B.56). 

Shortages  of  time  for  planning,  administration,  and  instruction  were  other  fac¬ 
tors  that  were  reported  to  hinder  improvement  efforts.  In  2006,  about  60  percent  of 
elementary  school  principals  and  about  40  percent  of  middle  school  principals  (down 
from  about  60  percent  in  2005) 8  reported  that  they  had  insufficient  staff  time  to  per¬ 
form  their  administrative  duties.  Each  year,  over  half  of  Pennsylvania  teachers  reported 
that  there  was  insufficient  class  time  to  cover  the  curriculum,  and  about  one-half  of 
elementary  school  teachers  and  about  30  percent  of  middle  school  teachers  reported 
that  there  was  inadequate  planning  time  built  into  the  school  day.  Responses  from 
principals  were  similar;  in  2006,  about  40  percent  of  elementary  school  principals  and 
20  percent  of  middle  school  principals  reported  that  lack  of  teacher  planning  time  was 
a  hindrance  to  school  improvement  (responses  were  similar  in  2005)9  (see  Tables  B.57 
to  B.59). 

Teachers  reported  that  large  class  sizes  and  a  wide  range  of  student  abilities  in  class 
were  hindrances  to  student  academic  success.  Each  year,  about  three-quarters  of  teach¬ 
ers  reported  that  the  wide  range  of  student  abilities  they  had  to  address  in  class  was  a 
hindrance  to  students’  academic  success.  Similarly,  about  half  of  teachers  reported  that 
large  class  sizes  hindered  students’  academic  success  in  2006  (slightly  lower  than  in 
2004)  (see  Table  B.60  and  B.56). 

Reported  district  capacity  to  support  school  improvement  decreased  between  2004 and 
2006.  Superintendents’  responses  indicated  that  fewer  districts  had  the  staff  capacity 
to  provide  school  support  in  2006  than  in  2004.  In  2004,  80  percent  of  districts  or 


8  We  did  not  ask  this  question  in  2004. 

9  We  did  not  ask  this  question  in  2004. 
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more  reported  adequate  capacity  to  facilitate  improvement  in  low-performing  schools, 
help  schools  analyze  data  for  school  improvement,  help  schools  identify  research-based 
strategies  for  improvement,  and  align  curriculum  with  state  content  standards  and 
state  assessments.  However,  by  2006  these  proportions  had  dropped  to  30  to  45  per¬ 
cent  of  districts.  This  pattern  is  in  stark  contrast  to  California  and  Georgia,  where 
reported  staff  capacity  typically  increased  over  the  three  years  from  already  high  levels 
in  2004  (see  Table  B.61). 

Some  districts  and  schools  were  hindered  by  shortages  of  highly  qualified  principals 
and  highly  qualified  mathematics  and  science  teachers,  and  one-half  of  districts  or  fewer 
were  hindered  by  a  lack  of  high-quality  PD  opportunities  for  principals  and  teachers.  A 
shortage  of  human  capital  was  a  concern  for  superintendents  and  principals,  as  well. 
Each  year,  20  to  30  percent  of  superintendents  reported  a  lack  of  qualified  principals, 
and  about  20  percent  of  middle  school  principals  reported  a  lack  of  highly  qualified 
teachers.  Shortages  of  qualified  mathematics  and  science  teachers  hindered  efforts  to 
improve  performance  in  30  to  40  percent  of  districts.  In  addition,  one-third  to  one-half 
of  superintendents  reported  each  year  that  their  improvement  efforts  were  hindered  by 
shortages  of  high-quality  PD  opportunities  for  principals  and  for  teachers.  About  one- 
half  of  middle  school  principals  also  reported  a  lack  of  high-quality  PD  opportunities 
for  teachers  in  2004  and  2006  (there  was  an  unexplained  dip  in  2005).  The  percentage 
of  elementary  school  principals  reporting  a  lack  of  high-quality  PD  opportunities  for 
both  principals  and  teachers  doubled  between  2004  and  2006,  from  about  15  percent 
to  about  one-third.  Shortages  of  qualified  aides  or  paraprofessionals  were  a  problem  for 
about  15  to  30  percent  of  principals  each  year  (see  Table  B.57). 

Most  teachers  reported  that  lack  of  parental  support  and  students’  lack  of  basic  skills 
impeded  their  efforts  to  improve  student  achievement.  Each  year,  about  70  percent  of 
elementary  school  teachers  and  80  percent  of  middle  school  teachers  reported  that 
their  efforts  to  improve  student  achievement  were  hindered  by  lack  of  support  from 
parents,  while  over  60  percent  of  elementary  school  teachers  and  over  80  percent  of 
middle  school  teachers  reported  that  inadequate  basic  skills  or  prior  preparation  was  a 
hindrance.  In  2006,  most  elementary  school  and  middle  school  teachers  reported  that 
inadequate  basic  skills  or  prior  preparation  and  lack  of  support  from  parents  were  hin¬ 
drances  to  students’  academic  success  (see  Figure  4.6).  In  addition,  student  absentee¬ 
ism  and  tardiness  were  concerns  for  half  of  the  elementary  school  teachers  and  over  70 
percent  of  the  middle  school  teachers  each  year  (see  Table  B.60). 

Administrators  reported  that  changes  in  state  policies  and  state  leadership,  as  well  as 
compliance  with  teacher  association  rules,  were  impediments  to  improvement.  Admin¬ 
istrative  concerns  hindered  some  superintendents  and  principals  in  their  efforts  to 
improve  performance.  Each  year,  more  than  two-thirds  of  superintendents  said  fre¬ 
quent  changes  in  state  policy  or  leadership  were  hindrances  to  improvement.  Super¬ 
intendent  reports  that  complying  with  teacher  association  rules  or  policies  hindered 
their  improvement  efforts  increased  from  about  40  percent  in  2004  to  70  percent 
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Figure  4.6 

Pennsylvania  Teachers  Reporting  That  Selected  Conditions  Were  Moderate  or  Great 
Hindrances  to  Students'  Academic  Success 
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in  2006.  In  2006,  about  one-quarter  of  superintendents  reported  that  disagreements 
with  district  school  boards  over  policies  hindered  their  improvement  efforts  (up  from 
fewer  than  10  percent  in  2004).  Some  principals  said  frequent  changes  in  district  policy 
or  district  leadership  hindered  their  improvement  efforts  (see  Table  B.62). 

Some  principals  reported  that  a  lack  of  guidance  for  teaching  special-needs  popula¬ 
tions  was  a  hindrance  to  their  school  improvement  efforts.  In  2005  and  2006,  about  one- 
quarter  of  elementary  school  principals  and  between  20  and  40  percent  of  middle 
school  principals  reported  that  a  lack  of  guidance  for  teaching  standards  to  special 
education  students  (i.e.,  students  in  IEPs)  was  a  moderate  or  great  hindrance  to  their 
school  improvement  efforts.  Between  15  and  30  percent  of  elementary  school  princi¬ 
pals  and  20  percent  or  fewer  middle  school  principals  cited  the  same  concern  in  refer¬ 
ence  to  ELLs  (see  Table  B.63). 


CHAPTER  FIVE 

Conclusions 


Although  this  study  examined  only  three  states,  we  think  the  results  can  be  valu¬ 
able  to  educators  and  policymakers  concerned  with  the  implementation  of  No  Child 
Left  Behind,  in  particular,  and  the  application  of  standards-based  accountability,  in 
general.  First,  we  observed  common  responses  across  districts  and  schools  in  Cali¬ 
fornia,  Georgia,  and  Pennsylvania  that  may  generalize  to  other  states.  Respondents 
had  strong  opinions  about  NCLB  itself,  steps  that  were  taken  to  implement  it,  and  its 
impact  on  their  practices.  Understanding  these  reactions  from  the  held  can  be  benefi¬ 
cial  in  thinking  about  how  to  achieve  the  goals  of  the  existing  legislation  and  improve 
future  authorizations  of  the  law.  Second,  in  some  cases,  educators’  responses  changed 
consistently  during  the  three  years  of  the  study.  Where  clear  trends  appeared,  we  can 
make  inferences  about  dynamic  features  of  implementation  to  help  set  expectations 
for  future  growth  or  decline.  Third,  there  were  some  notable  differences  in  responses 
among  the  three  states.  Although  these  differences  cannot  always  be  fully  explained 
in  terms  of  the  elements  of  state  context  that  we  measured,  context  can  often  be  used 
to  relate  results  from  this  study  to  other  states.  The  following  paragraphs  discuss  these 
three  types  of  conclusions  based  on  evidence  from  California,  Georgia,  and  Pennsylva¬ 
nia  during  the  period  2004  to  2006.  We  will  not  review  every  finding  from  the  study, 
but  we  will  draw  attention  to  issues  that  have  arisen  in  other  research  on  NCLB  and 
themes  that  might  be  of  particular  interest  for  future  efforts  to  design  and  implement 
standards  based  accountability.  Where  appropriate,  we  compare  results  of  this  study 
with  findings  from  recent  research  on  the  implementation  of  NCLB,  including  results 
from  the  National  Longitudinal  Study  of  No  Child  Left  Behind  (U.S.  Department  of 
Education,  2007a  and  2007b)  and  a  series  of  studies  conducted  by  the  Center  on  Edu¬ 
cation  Policy  (CEP,  2006,  2007a,  2007b,  and  2008). 
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Common  Themes  Across  the  Three  States 

States,  Districts,  and  Schools  Have  Adapted  Their  Policies  and  Practices  to  Support 
the  Implementation  of  NCLB 

Although  these  changes  took  a  few  years,  by  the  end  of  this  study,  all  three  states  had 
constructed  most  of  the  infrastructure  needed  to  support  standards-based  account¬ 
ability,  including  academic  standards,  aligned  assessments,  reporting  mechanisms,  and 
support  structures.  This  finding  is  consistent  with  national  reports  that  all  states  had 
adopted  academic  standards  and  were  making  progress  in  implementing  the  required 
tests  by  2005-2006  (U.S.  Department  of  Education,  2007b,  pp.  10-11).  Further¬ 
more,  educators  in  all  three  states  were  familiar  with  federal  rules  as  implemented  in 
their  states;  they  appeared  to  understand  the  language  of  the  reform,  the  policies  that 
affected  them  directly,  and  the  responsibilities  that  were  theirs. 

Alignment  Was  a  Major  Focus  of  Efforts  to  Implement  NCLB 

Efforts  were  made  at  all  levels — state,  district,  school,  and  classroom — to  ensure  consis¬ 
tency  among  the  standards,  assessments,  curriculum,  and  instruction.  There  were  some 
false  starts  (e.g.,  Georgia’s  initial  standards  were  judged  to  be  insufficiently  rigorous; 
Pennsylvania’s  initial  standards  lacked  the  level  of  detail  teachers  wanted),  but  states 
responded  with  changes  to  address  those  shortcomings.  Not  surprisingly,  alignment 
was  a  major  focus  of  implementation  efforts  across  the  country,  as  well.  Forty-nine 
states  reported  that  their  strategies  to  raise  student  achievement  relied  either  moder¬ 
ately  or  to  a  great  extent  on  having  curriculum  and  instruction  aligned  with  stan¬ 
dards  and/or  assessments  (CEP,  2007b,  p.  9).  Over  70  percent  of  schools  nationwide 
reported  that  aligning  curriculum  and  instruction  with  standards  and/or  assessments 
was  a  major  focus  of  their  school  improvement  efforts  (U.S.  Department  of  Education, 
2007b,  p.  88). 

Despite  all  these  efforts,  misalignment  remains  a  concern  among  a  minority  of 
teachers  in  these  three  states.  Teachers  reported  that  both  standards  and  assessments 
exclude  some  topics  that  are  part  of  their  local  curriculum  and  include  some  topics  that 
are  not.  Figure  5.1  shows  that  although  a  majority  of  math  and  science  teachers  in  each 
state  found  the  standards  useful  for  planning  lessons,  many  teachers  were  concerned 
that  the  standards  either  included  too  much  content  or  omitted  important  content. 
Such  misalignment  might  occur  because  textbook  adoptions  occur  infrequently  and 
some  districts  have  not  yet  caught  up,  because  old  materials  are  still  in  use,  or  because 
teachers  or  administrators  are  reluctant  to  change  a  curriculum  that  they  endorse  and / 
or  find  familiar. 

Similar  alignment  challenges  have  been  reported  in  national  studies.  For  exam¬ 
ple,  while  90  percent  of  teachers  nationwide  reported  that  they  had  access  to  district  or 
school  content  standards  to  augment  the  state  standards,  only  47  percent  had  access  to 
detailed  information  showing  the  alignment  of  required  textbooks  and  instructional 
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Figure  5.1 

Teachers  Agreeing  with  Statements  About  State  Academic  Standards,  2006 


Standards  do  not  cover  some 
important  content  areas 

Standards  include  more  content 
than  can  adequately  be 
covered  in  the  school  year 

Standards  are  useful  for 
planning  lessons 


Standards  do  not  cover  some 
important  content  areas 

Standards  include  more  content 
than  can  adequately  be 
covered  in  the  school  year 

Standards  are  useful  for 
planning  lessons 


0  10  20  30  40  50  60  70  80  90  100 

Percentage 

RAND  MG 784  5.7 

programs  to  state  standards  (U.S.  Department  of  Education,  2007b,  p.  90).  Eighteen 
percent  of  teachers  said  that  having  textbooks  that  are  not  aligned  with  state  standards 
was  a  moderate  or  major  challenge  to  improving  student  performance  (U.S.  Depart¬ 
ment  of  Education,  2007b,  p.  91). 

Educators  Think  That  Test  Results  Are  a  Good  Measure  of  Student  Mastery  and 
Provide  Useful  Information  for  Improving  Curriculum  and  Instruction 

Despite  some  reported  mismatches  between  testing  and  curriculum,  most  administra¬ 
tors  and  many  teachers  in  all  three  states  report  that  test  results  provide  a  good  measure 
of  student  mastery,  i.e.,  they  are  confident  in  the  quality  of  the  information  provided 
by  the  tests.  Confidence  in  the  value  of  test  results  can  also  be  inferred  from  the  wide¬ 
spread  adoption  in  these  three  states  of  periodic  progress  tests  to  monitor  instruction 
more  frequently.  In  fact,  progress  tests  are  becoming  far  more  common  across  the 
country;  two-thirds  of  schools  reported  supplementing  annual  state  tests  with  progress 
assessments  (U.S.  Department  of  Education,  2007b,  p.  97).  Teachers  in  California, 
Georgia,  and  Pennsylvania  schools  that  adopted  progress  tests  agree  that  those  tests  are 
good  measures  of  student  mastery,  as  well. 

Teachers  also  report  that  the  information  they  obtain  from  student  tests  is  useful 
for  identifying  and  correcting  gaps  in  curriculum  and  instruction.  This  finding  is  con¬ 
sistent  with  national  reports  of  efforts  to  use  achievement  data  for  school  improvement. 
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For  example,  82  percent  of  identified  schools  and  67  percent  of  nonidentified  schools 
said  that  using  data  to  inform  instruction  was  a  major  focus  of  their  school  improve¬ 
ment  efforts  (U.S.  Department  of  Education,  2007b,  p.  88).  In  fact,  teachers  in  schools 
that  use  progress  tests  were  more  likely  to  report  that  progress  tests  were  useful  for 
identifying  and  correcting  gaps  in  curriculum  and  instruction  than  teachers  in  all 
schools  were  to  report  that  annual  state  tests  were  useful  for  these  purposes. 

Most  Educators  Report  That  NCLB  Has  Had  a  Positive  Impact  on  Teaching  and 
Learning,  Although  Concerns  Remain  About  Potential  Negative  Effects  on  Some 
Students 

Almost  all  administrators  and  most  teachers  in  California,  Georgia,  and  Pennsylva¬ 
nia  agreed  that  state  academic  standards  were  useful  guides  and  that  standards-based 
accountability  had  led  to  certain  improvements  in  instruction.  In  particular,  educators 
in  these  three  states  felt  that  NCLB  had  led  teachers  to  focus  more  on  student  learn¬ 
ing  and  had  resulted  in  improvement  in  the  academic  rigor  of  the  curriculum.  CEP 
(2007b,  p.  2)  reports  that  educators  think  the  NCLB  interventions  for  low-performing 
schools — such  as  extending  the  day,  assigning  outside  experts,  or  implementing  new 
curriculum — are  effective,  as  well. 

However,  many  teachers  raised  concerns  that  the  system  was  not  serving  all  stu¬ 
dents  equally  well.  For  example,  many  thought  that  NCLB  led  teachers  to  focus  on  the 
bubble  kids — those  near  the  proficient  level  (perhaps  at  the  expense  of  students  who 
had  farther  to  go  to  reach  proficiency).  As  can  be  seen  in  Figure  5.2,  the  percentage 
of  elementary  school  math  teachers  who  reported  that  they  focused  more  on  students 
who  were  close  to  proficient  as  a  result  of  the  state  math  assessment  increased  over 
time  in  each  of  the  three  states  we  studied  (although  the  change  was  not  statistically 
significant  in  Pennsylvania).  In  addition,  some  teachers  reported  that  high-achieving 
students  were  not  receiving  appropriately  challenging  curriculum  and  instruction. 

Despite  the  Changes  in  Alignment  and  Instructional  Planning,  It  Appears  That 
Teaching  Techniques  Have  Generally  Not  Changed 

Teachers  in  California,  Georgia,  and  Pennsylvania  reported  many  changes  that  relate 
to  instruction  (e.g.,  aligning  the  content  of  lessons  with  the  standards,  using  test  results 
to  make  instructional  plans),  but  they  did  not  appear  to  have  made  changes  in  their 
regular  interactions  with  students  (e.g.,  direct  instruction,  use  of  peer  coaching).  The 
evidence  we  collected  suggests  that  teachers  were  not  changing  their  day-to-day  instruc¬ 
tional  techniques  in  response  to  NCLB.  This  Ending  is  interesting  in  light  of  national 
reports  that  most  districts  are  providing  training  to  help  teachers  change  their  teach¬ 
ing  techniques  to  be  more  effective.  In  one  national  study,  over  60  percent  of  districts 
reported  that  they  were  training  teachers  to  use  specific  methods  to  address  the  aca¬ 
demic  needs  of  low-performing  subgroups  of  students  in  either  reading  or  mathemat¬ 
ics  (CEP,  2007b,  p.  25).  Our  surveys  may  not  have  been  sensitive  to  these  particular 
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Figure  5.2 

Elementary  School  Teachers  Reporting  That  They  Focused  More  on  Students  Near 
Proficiency  in  Mathematics  as  a  Result  of  State  Mathematics  Assessments 
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efforts,  or  districts  in  these  states  may  not  have  been  typical  of  the  nation;  however,  it 
would  be  wise  to  explore  further  the  actual  impact  of  districts’  PD  efforts  on  teachers’ 
instructional  practices. 

Teachers  Are  Less  Sanguine  Than  Administrators  About  the  Validity  of  Test  Scores 
and  the  Impact  of  NCLB  on  Students 

In  all  three  states,  teachers  were  more  likely  than  administrators  to  find  fault  with  the 
state  tests  and  to  worry  about  the  impact  of  the  reform  on  certain  students.  For  exam¬ 
ple,  fewer  teachers  than  administrators  thought  the  tests  were  good  measures  of  stu¬ 
dent  performance,  and  many  teachers  reported  that  the  tests  were  too  difficult  for  their 
students.  Figure  5.3  shows  that  in  2006,  a  smaller  proportion  of  teachers  than  either 
district  administrators  or  school  principals  thought  that  state  exams  were  valid  indi¬ 
cators  of  student  achievement.  As  can  be  seen  in  Figure  5.4,  principals  were  generally 
more  likely  than  were  teachers  to  think  that  the  accountability  system  overall  had  been 
beneficial  for  students.  Our  case  study  interviews  suggest  that  teachers  were  acutely 
aware  of  the  problems  some  students  had  performing  well  on  state  tests,  and  they  may 
be  less  optimistic  in  their  judgments  as  a  result.  Administrators,  who  are  farther  from 
the  classroom,  may  be  less  attuned  to  these  specific  concerns. 
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Figure  5.3 

Educators  Agreeing  That  State  Assessment  Scores  Accurately  Reflect  Student  Achievement 
(Administrators)  or  Are  Good  Measures  of  Student  Mastery  (Teachers),  2006 
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Districts  and  Schools  Are  Engaged  in  a  Wide  Variety  of  Reforms 

Superintendents  and  principals  reported  making  many  changes  in  efforts  to  improve 
performance.  The  most  attention  has  been  paid  to  alignment,  focusing  on  low- 
performing  students,  and  using  test  results.  Yet,  almost  every  strategy  included  in 
the  survey  was  endorsed  by  a  majority  of  respondents.  This  multifaceted  approach 
to  school  improvement  is  consistent  with  national  reports  that  nearly  all  schools  are 
making  many  improvement  efforts.  For  example,  more  than  half  of  the  principals 
reported  placing  a  major  emphasis  on  nine  of  the  ten  improvement  strategies  included 
in  the  National  Longitudinal  Study  of  the  NCLB  school  survey  (U.S.  Department  of 
Education,  2007b,  p.  88). 

There  Are  Small  but  Notable  Differences  in  Implementation  Between  Elementary 
and  Middle  Schools 

In  this  study,  as  in  other  studies  of  NCLB,  there  were  a  number  of  differences  in 
responses  associated  with  school  level.  For  example,  elementary  schools  in  California, 
Georgia,  and  Pennsylvania  were  more  likely  than  middle  schools  to  implement  prog¬ 
ress  tests  and  to  be  required  to  implement  a  new  curriculum.  The  first  Ending  is  con¬ 
sistent  with  the  National  Longitudinal  Study  of  NCLB,  which  found  that  76  percent 
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Figure  5.4 

Educators  Agreeing  That  State's  Accountability  System  Has  Been  Beneficial  for  Students, 
2006 
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of  elementary  schools  were  administering  progress  tests  in  reading  compared  with  57 
percent  of  middle  schools  and  only  48  percent  of  high  schools  (U.S.  Department  of 
Education,  2007b,  p.  98).  Elementary  school  teachers  in  the  current  study  were  more 
likely  than  middle  school  teachers  to  receive  PD  that  focused  on  the  use  of  test  results. 
By  comparison,  the  National  Longitudinal  Study  did  not  find  big  differences  in  the 
amount  of  PD  focusing  on  mathematics  and  reading  instruction  that  was  received  by 
elementary  and  secondary  teachers  (U.S.  Department  of  Education,  2007a,  p.  72). 
Yet,  CEP  (2007b,  pp.  19-20)  reported  that  districts  were  more  likely  to  use  selected 
improvement  strategies — including  increasing  the  amount  of  PD — with  identified  ele¬ 
mentary  schools  than  with  identified  secondary  schools.  Furthermore,  in  two  of  the 
three  states,  a  higher  proportion  of  elementary  school  teachers  than  middle  school 
teachers  increased  the  time  they  devoted  to  mathematics  in  each  of  the  three  years  we 
studied.  We  hypothesize,  as  did  the  authors  of  the  CEP  report,  that  some  of  these  dif¬ 
ferences  can  be  attributed  to  the  fact  that  schedules  are  typically  less  flexible  in  second¬ 
ary  schools,  where  students  have  different  teachers  for  each  subject.  It  is  also  interesting 
to  note  that  elementary  school  principals  in  California,  Georgia,  and  Pennsylvania 
were  more  likely  than  middle  school  principals  to  believe  their  school  would  make  AYP 
over  the  next  five  years. 
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There  Are  Major  Differences  in  Implementation  Between  the  Subjects  of 
Mathematics  and  Science 

The  NCLB  guidelines  give  states  more  time  to  implement  science  standards  and  tests 
than  mathematics  or  reading  standards  and  tests,1  require  science  testing  at  fewer  grade 
levels  than  mathematics  and  reading  testing,  and  do  not  include  science  results  in 
determining  a  school’s  AYP.  As  a  result,  in  California,  Georgia,  and  Pennsylvania  far 
more  effort  has  been  made  to  implement  standards-based  accountability  in  mathemat¬ 
ics  than  in  science.  This  finding  is  illustrated  by  the  fact  that  fewer  schools  report 
aligning  their  science  programs  with  standards,  implementing  a  new  science  curricu¬ 
lum,  allocating  more  time  to  science  instruction,  or  providing  PD  for  teaching  science. 
While  not  surprising  given  the  NCLB  requirements,  this  pattern  is  worthy  of  note 
because  it  illustrates  an  important  feature  of  standards-based  accountability:  Subjects 
that  do  not  “count”  as  much  do  not  command  resources  or  attention.2 

Administrative  Efforts  Were  Hindered  by  Lack  of  Funding  and  Lack  of  Time; 
Instructional  Efforts  Were  Hindered  by  Lack  of  Time,  Large  and  Heterogeneous 
Classes,  and  Poor  Student  Preparation 

Meeting  the  expectations  of  NCLB  has  proven  to  be  a  challenging  task,  and  educators 
in  California,  Georgia,  and  Pennsylvania  highlighted  a  number  of  factors  that  hinder 
their  progress.  Both  superintendents  and  principals  reported  that  inadequate  funding 
presents  an  obstacle  to  improvement.  They  also  complained  that  administrative  staff 
has  inadequate  time  to  perform  all  their  duties.  Time  was  also  a  concern  when  it  comes 
to  instruction.  Most  teachers  said  there  is  inadequate  class  time  to  cover  the  curricu¬ 
lum,  and  about  half  said  they  also  lack  adequate  planning  time  during  the  day.  Teach¬ 
ers  also  reported  that  their  efforts  are  hampered  by  the  large  number  of  students  in 
their  classes  and  the  wide  range  of  student  abilities  they  have  to  address.  Finally,  teach¬ 
ers  were  concerned  that  their  students  lack  basic  skills  (that  they  should  have  learned 
previously)  and  that  they  do  not  receive  adequate  support  from  parents.  Some  of  these 
concerns  echo  findings  from  a  CEP  case  study  of  restructuring  schools  in  California; 
many  respondents  reported  that  schools’  efforts  to  raise  achievement  were  hampered  by 
factors  outside  of  their  control  (CEP,  2008,  p.  2). 


1  States  did  not  have  to  implement  science  tests  until  2007-2008,  the  year  after  our  third  round  of  surveys. 

2  It  is  worth  noting  that  California’s  own  accountability  system  did  include  science  results,  although  science 
counted  for  only  a  small  percentage  of  a  school’s  score. 
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Trends 

Patterns  based  on  three  years  of  data  can  only  cautiously  be  interpreted  as  trends. 
Nevertheless,  it  is  interesting  to  note  the  following  instances  in  which  we  found  con¬ 
sistently  increasing  or  decreasing  reports  during  the  study  period. 

State  Infrastructure  for  Accountability  Has  Improved 

According  to  reports  from  administrators  and  teachers,  the  departments  of  educa¬ 
tion  in  these  three  states  were  generally  becoming  more  efficient  with  their  assessment 
and  reporting  systems,  providing  information  more  quickly  or  in  more  diverse  ways. 
This  finding  is  consistent  with  national  reports  that  found  that  states  were  improving 
their  data  systems  during  this  period  (U.S.  Department  of  Education,  2007b,  p.  65). 
Improved  data  systems  are  one  of  the  ways  in  which  the  impact  of  the  law  continued 
to  “broaden  and  deepen”  during  this  period  (CEP,  2006,  p.  vii).  While  there  were  also 
some  improvements  at  the  local  level  (e.g.,  fewer  reports  of  shortages  of  aligned  curri¬ 
cula,  inadequate  facilities,  or  inadequate  funding),  local  conditions  were  static  in  many 
districts  in  California,  Georgia,  and  Pennsylvania. 

State  Reporting  of  Test  Results  Has  Become  Timelier  and  More  Complete 

Despite  some  problems  with  test  administration  in  Georgia  and  the  implementation  of 
new  examinations  in  Pennsylvania,  the  reporting  of  test  results  has  generally  improved 
over  this  time  period.  Growing  percentages  of  elementary  school  respondents  in  all 
three  states  (and  secondary  school  respondents  in  Georgia)  said  that  test  results  were 
being  provided  in  a  more  timely  manner,  or  that  they  had  access  to  subgroups  or 
subtopic  data,  or  both.  Again,  this  finding  matches  national  findings  that  states  were 
improving  the  timeliness  of  their  performance  reports  during  this  period  (U.S.  Depart¬ 
ment  of  Education,  2007b,  p.  64-65). 

The  Use  of  Progress  Tests  Is  Growing,  as  Are  Efforts  to  Use  Test  Results  for 
Instructional  Decisionmaking 

Increasing  proportions  of  educators  reported  that  periodic  progress  assessments  were 
being  administered  to  students  so  teachers  would  have  more  frequent  and  immediate 
data  to  use  for  instructional  planning.  Figure  5.5  shows  that  in  each  state  the  percent¬ 
age  of  math  teachers  who  reported  that  they  were  required  to  administer  progress  tests 
increased  from  2004  to  2006  (although  the  changes  from  2004  to  2006  were  not 
always  statistically  significant).  Also,  teachers  were  more  likely  to  report  that  the  results 
from  such  progress  tests  were  useful  to  them  than  the  results  from  annual  state  assess¬ 
ments.  This  growth  is  consistent  with  a  growing  emphasis  on  data-driven  decisionmak¬ 
ing  as  a  school  improvement  tool  (Marsh,  Pane,  and  Elamilton,  2006).  Our  longitudi¬ 
nal  study  allows  us  to  monitor  growth  more  closely  than  the  national  studies  of  NCLB 
implementation,  but  these  findings  are  consistent  with  the  prominence  of  progress  tests 
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Figure  5.5 

Teachers  Required  to  Administer  Mathematics  Progress  Tests 
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and  efforts  to  promote  the  use  of  test  data  for  improvement  that  have  been  reported 
nationally  (CEP,  2007b;  U.S.  Department  of  Education,  2007b).  Neither  this  study 
nor  the  national  studies  offer  much  evidence  about  the  success  of  such  efforts,  but  they 
are  generally  endorsed  by  teachers  and  administrators  in  these  three  states. 

Educators  Are  Growing  More  Positive  Toward  Accountability  Policies 

Growing  proportions  of  educators  in  the  three  states  reported  that  accountability  has 
improved  the  academic  rigor  of  the  curriculum  and  increased  the  school’s  focus  on 
student  learning.  During  this  period,  teachers  were  also  more  likely  to  report  that  their 
own  teaching  had  improved  as  a  result  of  accountability  (although  these  gains  were  not 
always  statistically  significant  and  there  were  no  changes  over  time  in  their  reported 
use  of  specific  teaching  practices). 

Concerns  About  Low  Morale  Continue,  but  Are  Becoming  Less  Common 

Educators  in  these  three  states  raised  concerns  about  the  negative  effects  of  account¬ 
ability,  particularly  its  impact  on  teacher  morale.  This  Ending  is  consistent  with  CEP 
reports  from  several  districts  that  “NCLB  has  escalated  pressure  on  teachers  to  a  stress¬ 
ful  level  and  has  negatively  affected  staff  morale  in  some  schools”  (CEP,  2006,  p.  1). 
Yet,  the  prevalence  of  these  concerns  in  California,  Georgia,  and  Pennsylvania  declined 
during  the  period  of  this  study,  as  can  be  seen  clearly  in  Figure  5.6.  We  cannot  say 
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Figure  5.6 

Teachers  Agreeing  That  Staff  Morale  Has  Changed  for  the  Worse  as  a  Result  of 
Accountability 
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whether  the  decline  reflects  positive  changes  in  the  environment  or  readjustment  on 
the  part  of  respondents,  but  it  is  certainly  a  welcome  development. 


Distinctive  Approaches  by  States 

We  also  observed  differences  in  NCLB  implementation  among  the  states  in  a  number 
of  areas.  These  differences  may  be  explained,  in  part,  by  three  facts.  First,  the  states  set 
very  different  levels  for  proficiency.  We  did  not  observe  this  directly,  but  using  NAEP 
as  a  yardstick,  other  researchers  have  established  that  there  are  substantial  differences 
among  these  three  states  in  the  difficulty  of  the  proficiency  cutoff  point  (U.S.  Depart¬ 
ment  of  Education,  2007b,  p.  19).  The  Georgia  standard  for  proficiency  is  less  rigorous 
than  the  Pennsylvania  standard,  which  is,  in  turn,  less  rigorous  than  the  California 
standard  (NCES,  2007).  One  consequence  of  the  differences  in  proficiency  levels  is 
that  the  percentage  of  proficient  students  is  much  greater  in  Georgia  than  in  the  other 
states.  This  translates  into  differences  in  AMO  starting  points  for  schools  and  differ¬ 
ences  in  annual  gains  required  to  stay  on  target.  As  a  result,  meeting  annual  targets 
may  be  easier  in  Georgia  than  in  Pennsylvania  or  California.  A  second  factor  is  that 
Georgia  is  a  “right  to  work”  state,  and  teacher  unions  are  not  a  strong  presence  in  rela- 


74  Pain  and  Gain:  Implementing  No  Child  Left  Behind  in  Three  States,  2004-2006 


tions  between  teachers  and  school  districts.  Third,  California  has  a  more  diverse  stu¬ 
dent  population  than  the  other  two  states,  and  more-heterogeneous  schools  must  meet 
more  targets  under  NCLB  and  tend  to  make  AYP  at  lower  rates.  These  are  just  three  of 
many  context  and  policy  differences  among  the  states.  With  this  background  in  mind, 
we  highlight  a  few  state-level  differences. 

States  Varied  in  Their  Capacity  to  Implement  NCLB 

NCLB  has  placed  additional  demands  on  states,  and  many  lack  the  capacity  to  respond. 
According  to  a  2006  national  study,  36  states  did  not  have  enough  staff  to  implement 
NCLB,  and  33  states  found  that  federal  funds  were  inadequate  to  assist  all  schools 
that  were  identified  for  improvement  (CEP,  2006,  pp.  ix-x).  California,  Georgia,  and 
Pennsylvania  differed  in  a  number  of  ways  that  influenced  their  capacity  to  implement 
NCLB  and  to  support  district  and  school  improvement.  Pennsylvania  had  a  strong 
tradition  of  local  control  and  a  relatively  decentralized  education  system  prior  to  2001. 
The  Pennsylvania  Department  of  Education  was  small  compared  with  those  of  the 
other  states,  and  it  had  less  experience  in  a  number  of  areas.  As  a  result,  Pennsylvania 
was  slower  to  implement  many  of  the  provisions  of  NCLB  and  provided  less  direct  sup¬ 
port  to  schools  and  districts.  For  example,  Pennsylvania  superintendents  were  less  likely 
than  their  counterparts  in  California  and  Georgia  to  report  receiving  needed  technical 
assistance  from  the  state;  fewer  principals  and  teachers  in  Pennsylvania  reported  receiv¬ 
ing  information  in  a  timely  manner;  and  more  teachers  reported  not  understanding  the 
state  test  results.  National  studies  confirm  that  some  state  agencies  have  greater  capac¬ 
ity  challenges  than  others  (CEP,  2007a,  p.  2),  and  they  document  wide  variation  in  the 
strategies  states  have  employed  to  provide  support  services  to  schools  and  districts  (U.S. 
Department  of  Education,  2007a,  pp.  74-78).  Our  three-state  study  highlights  some  of 
the  ways  these  capacity  and  support  issues  manifest  themselves  in  particular  states. 

Georgia  was  unique  among  the  three  states  in  having  science  assessments  in  place 
in  grades  three  through  eight  prior  to  NCLB.  As  a  result,  science  assessments  were 
more  familiar  to  educators  in  Georgia,  and  more  districts  in  the  state  were  implement¬ 
ing  progress  testing  in  science.  California  had  a  distinctive  policy  with  respect  to  test 
preparation  during  much  of  this  period.  The  California  Department  of  Education  did 
not  release  any  items  from  its  state  test,  and  it  had  a  policy  that  discouraged  test  prepa¬ 
ration  behaviors  that  might  appear  to  be  inappropriate.  As  a  result,  teachers  were  less 
likely  to  report  certain  test-focused  classroom  practices. 

Georgia  Educators  Were  Relatively  More  Positive  Toward  NCLB  Than  Were 
California  or  Pennsylvania  Educators 

While  there  was  general  agreement  among  educators  across  the  states  on  many  of  the 
issues  we  addressed,  responses  from  Georgia  were  often  more  positive  than  responses 
from  the  other  states.  Furthermore,  in  some  cases  Georgia  educators  responded  posi¬ 
tively  while  educators  in  the  other  two  states  gave  mixed  or  negative  responses.  These 
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findings  may  be  the  result  of  better  implementation:  Georgia  teachers  were  more  likely 
to  report  that  they  received  sufficient  technical  assistance  than  did  teachers  in  other 
states.  However,  the  Georgia  advantage  may  also  be  due  to  “external”  confounding 
factors.  We  hinted  above  at  one  possible  explanation:  Georgia  educators  were  having 
more  success  meeting  their  AYP  targets  relative  to  educators  in  California  and  Penn¬ 
sylvania  because  they  had  lower  targets.  Another  possibility,  which  we  did  not  explore 
in  this  study,  is  that  Georgia  educators  are  generally  not  affiliated  with  national  unions; 
teacher  unions  in  their  desire  to  protect  teachers’  rights  may  resist  external  interven¬ 
tions  like  those  associated  with  NCLB. 


Looking  Ahead 

This  study  suggests  that  NCLB  has  led  to  distinctive  accountability  systems  in  each 
state,  although  each  was  derived  from  the  same  federal  legislation.  States  used  the 
flexibility  in  the  law  to  develop  accountability  systems  that  reflect  local  conditions. 
The  reauthorization  of  ESEA  should  recognize  that  this  variation  exists  and  develop 
policies  accordingly.  In  some  cases,  new  regulations  may  be  needed  to  reduce  or  elimi¬ 
nate  differences — e.g.,  to  make  proficiency  in  reading  and  mathematics  similar  across 
states.  This  study  found  a  number  of  attitudes  and  behaviors  associated  with  the  overall 
level  of  student  proficiency  in  the  states.  In  other  cases,  it  may  be  appropriate  to  relax 
rules  to  give  states  additional  flexibility.  This  study  suggests  that  school  improvement 
efforts  might  be  more  effective  if  they  were  responsive  to  local  conditions.  Rather  than 
imposing  a  fixed  set  of  choices  that  apply  when  schools  fail  to  achieve  AYP  for  a  given 
number  of  years,  improvement  efforts  should  be  customized  to  address  the  specific 
causes  of  the  failure  and  the  capacity  that  exists  locally. 

There  is  also  a  lesson  for  SBA  in  general.  Educators  have  become  comfortable  with 
the  underlying  SBA  theory  of  action — set  clear  goals,  develop  measures,  and  establish 
consequences  to  encourage  educators  to  achieve  them.  They  are  not  comfortable  when 
the  implementation  of  that  theory  seems  inconsistent  with  their  local  situation — e.g., 
when  the  standards  do  not  match  their  local  curriculum,  when  the  proficient  level 
seems  unattainable  for  many  of  their  students,  or  when  their  school  is  judged  against 
targets  that  feel  unattainable.  It  would  seem  that  engaging  educators  in  the  develop¬ 
ment  or  refinement  of  the  SBA  framework  (e.g.,  the  reauthorization  of  NCLB)  would 
be  a  good  way  to  attempt  to  bridge  this  gap. 


APPENDIX  A 


Sampling  and  Response  Rate  Tables 


Tables  A.l  through  A. 6  show  the  sampling  and  response  rates  for  our  study. 


Table  A.l 

Size  of  K-12  Public  School  Systems,  2005-2006 


Feature 

California 

Georgia 

Pennsylvania 

Districts 

1,128 

204 

730 

Schools 

9,863 

2,489 

3,250 

Teachers 

309,198 

108,535 

122,397 

Students 

6,437,202 

1,598,461 

1,830,684 

SOURCE:  NCES  (undated). 


Table  A. 2 

Student  Demographic  Characteristics,  2003-2004 


Characteristic 

California  (%) 

Georgia  (%) 

Pennsylvania  (%) 

White 

30 

48 

75 

Hispanic 

47 

8 

6 

Black 

8 

38 

16 

Asian 

11 

3 

2 

Eligible  for  free/reduced-price  lunch 

48 

50 

31 

ELLs 

24 

5 

3 

Students  with  disabilities 

11 

12 

15 

SOURCES:  ELL  data  for  Pennsylvania  come  from  Pennsylvania  Department  of  Education  (2006). 
All  other  data  come  from  NCES  (undated). 
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Table  A.3 

District  Sample  and  Cooperation,  2003-2004,  2004-2005,  and  2005-2006 


Sampling 

California 

Georgia 

Pennsylvania 

Total 

2003-2004 

Initial  sample  number 

27 

27 

27 

81 

Replacement  sample  number 

13 

5 

5 

23 

Total  sample  number 

40 

32 

32 

104 

Number  cooperating 

19 

25 

24 

68 

Cooperation  rate  (%) 

47.5 

78.1 

75 

65.4 

2004-200S  and  2005-2006 

Total  sample  number 

56 

37 

39 

132 

Number  cooperating 

31 

30 

31 

92 

Cooperation  rate  (%) 

55 

81 

80 

70 

Table  A. 4 

School  Sample  and  Cooperation,  2003-2004, 

2004-2005, 

and  2005-2006 

Sampling 

California 

Georgia 

Pennsylvania 

Total 

2003-2004 

No.  in  sample 

78 

116 

103 

297 

No.  of  cooperating  schools 

63 

108 

96 

267 

Cooperation  rate  (%) 

80.7 

93.1 

93.2 

89.9 

2004-2005 

No.  in  sample 

122 

124 

107 

353 

No.  of  cooperating  schools 

91 

111 

99 

301 

Cooperation  rate  (%) 

75 

90 

93 

85 

2005-2006 

No.  in  sample 

122 

124 

107 

353 

No.  of  cooperating  schools 

91 

111 

97 

299 

Cooperation  rate  (%) 

74.6 

89.5 

90.7 

84.7 
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Table  A.5 

Superintendent  Survey  Responses,  2003-2004,  2004-2005,  and  2005-2006 


Response 

California 

Georgia 

Pennsylvania 

Total 

2003-2004 

No.  of  cooperating  districts 

19 

25 

24 

68 

No.  completing  superintendent  survey 

18 

20 

22 

60 

Survey  response  rate  (%) 

94.7 

80 

91.6 

88.2 

2004-2005 

No.  of  cooperating  districts 

31 

30 

31 

92 

No.  completing  superintendent  survey 

24 

24 

19 

67 

Survey  response  rate  (%) 

77.4 

80.0 

61.3 

72.8 

2005-2006 

No.  of  cooperating  districts 

31 

30 

31 

92 

No.  completing  superintendent  survey 

26 

21 

20 

67 

Survey  response  rate  (%) 

83.9 

70.0 

64.5 

72.8 
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Table  A. 6 


Principal  and  Teacher  Survey  Responses,  2003- 

-2004,  2004- 

-2005,  and  2005- 

-2006 

Sampling  and  Response 

California 

Georgia 

Pennsylvania 

Total 

2003-2004 

No.  of  cooperating  schools 

63 

108 

96 

267 

No.  of  principal  survey  responses 

51 

88 

88 

227 

Principal  response  rate  (%) 

80.9 

81.5 

91.7 

85.3 

No.  in  teacher  sample 

692 

1,522 

1,073 

3,287 

No.  of  teacher  survey  responses 

487 

1,318 

926 

2,731 

Teacher  response  rate  (%) 

70.4 

86.6 

86.3 

83.1 

2004-2005 

No.  of  cooperating  schools 

91 

111 

99 

301 

No.  of  principal  survey  responses 

78 

95 

87 

260 

Principal  response  rate  (%) 

86 

86 

88 

86 

No.  in  teacher  sample 

1,013 

1,605 

1,050 

3,668 

No.  of  teacher  survey  responses 

826 

1,409 

938 

3,173 

Teacher  response  rate  (%) 

81.5 

87.8 

89.3 

86.5 

2005-2006 

No.  of  cooperating  schools 

91 

111 

97 

299 

No.  of  principal  survey  responses 

75 

96 

88 

259 

Principal  response  rate  (%) 

82.4 

86.5 

90.7 

86.6 

No.  in  teacher  sample 

972 

1,574 

1,059 

3,605 

No.  of  teacher  survey  responses 

670 

1,366 

931 

2,967 

Teacher  response  rate  (%) 

68.9 

86.8 

87.9 

82.3 

APPENDIX  B 


Results  Tables 


For  explanations  of  the  abbreviations  in  the  results  tables,  see  the  abbreviations  list  in 
the  front  matter. 


Table  B.1 

Teachers  Agreeing  That  Standards  Are  Useful  for  Planning  Lessons 


Standards 

California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Math 

91 

88 

90 

91 

88 

86 

76 

73 

81 

(2) 

(2) 

(2) 

(D 

(D 

(2) 

(3) 

(3) 

(2) 

Science 

86 

84 

81 

90 

84 

83 

44 

43 

54 

(3) 

(2) 

(3) 

(D 

(2) 

(2) 

(4) 

(3) 

(3) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


81 


Table  B.2 

Teachers  Agreeing  with  Statements  About  Content  Coverage  of  State  Standards 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

State  content  standards  for  mathematics 

Include  more 

83 

86 

81 

85 

81 

84 

70 

84 

68 

71 

55 

59 

74 

78 

64 

74 

65 

78 

content  than  can  be 

(3) 

(3) 

(3) 

(3) 

(3) 

(4) 

(3) 

(2) 

(3) 

(3) 

(3) 

(4) 

(4) 

(6) 

(4) 

(6) 

(4) 

(5) 

adequately  covered 
in  the  school  year 

Do  not  cover  some 

15 

23 

20 

21 

24 

27 

22 

27 

21 

24 

17 

27 

15 

30 

22 

34 

23 

34 

important  content 

(2) 

(5) 

(3) 

(4) 

(3) 

(4) 

(2) 

(2) 

(2) 

(2) 

(2) 

(2) 

(2) 

(6) 

(2) 

(5) 

(2) 

(5) 

areas 

State  content  standards  for  science 

Include  more 

60 

74 

65 

79 

60 

79 

56 

82 

53 

78 

43 

56 

49 

78 

55 

62 

60 

77 

content  than  can  be 
adequately  covered 
in  the  school  year 

(6) 

(5) 

(4) 

(3) 

(4) 

(4) 

(3) 

(2) 

(3) 

(3) 

(3) 

(4) 

(4) 

(3) 

(4) 

(6) 

(3) 

(4) 

Do  not  cover  some 

15 

40 

19 

37 

23 

45 

35 

29 

36 

34 

23 

41 

19 

33 

22 

37 

24 

41 

important  content 

(4) 

(7) 

(3) 

(4) 

(3) 

(7) 

(3) 

(3) 

(2) 

(4) 

(2) 

(3) 

(4) 

(6) 

(4) 

(9) 

(3) 

(5) 

areas 


NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree.  Percentages  represent  the  sum  of  the  agree  and  strongly 
agree  responses. 
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Table  B.3 

Administrators  Agreeing  That  State  Assessment  Scores  Accurately  Reflect  Student 
Achievement 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


Respondent 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

District 

95 

65 

68 

78 

68 

84 

32 

49 

44 

superintendents 

(5) 

(12) 

(10) 

(10) 

(13) 

(8) 

(11) 

(15) 

(13) 

Elementary  school 

65 

34 

60 

78 

75 

70 

58 

56 

64 

principals 

(12) 

(10) 

(8) 

(5) 

(6) 

(7) 

(11) 

(10) 

(8) 

Middle  school 

70 

64 

63 

60 

64 

61 

29 

40 

42 

principals 

(13) 

(11) 

(13) 

(8) 

(8) 

(8) 

(11) 

(12) 

(11) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.4 

Teachers  Agreeing  with  Statements  About  State  Math  Assessments 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

The  state  math  assessment 

Is  a  good  measure  of 

38 

39 

42 

38 

42 

47 

56 

55 

60 

57 

59 

57 

38 

36 

45 

50 

50 

42 

students'  mastery  of 
content  standards 

(3) 

(5) 

(3) 

(4) 

(4) 

(3) 

(3) 

(3) 

(2) 

(3) 

(3) 

(3) 

(4) 

(7) 

(4) 

(4) 

(4) 

(8) 

Is  too  difficult  for 

48 

70 

47 

65 

46 

54 

26 

48 

31 

46 

25 

36 

59 

75 

47 

64 

40 

61 

the  majority  of  my 
students 

(5) 

(5) 

(5) 

(4) 

(6) 

(4) 

(3) 

(3) 

(3) 

(2) 

(3) 

(3) 

(5) 

(6) 

(4) 

(4) 

(4) 

(8) 

Includes  considerable 

27 

39 

33 

32 

27 

27 

19 

24 

24 

27 

18 

23 

32 

43 

25 

43 

17 

45 

content  that  is  not  in 
our  curriculum 

(5) 

(6) 

(3) 

(4) 

(3) 

(2) 

(2) 

(2) 

(2) 

(2) 

(2) 

(3) 

(4) 

(5) 

(3) 

(6) 

(3) 

(5) 

Omits  considerable 

30 

38 

35 

30 

36 

32 

26 

34 

26 

37 

25 

29 

24 

37 

27 

49 

26 

36 

content  that  is  in  our 

(5) 

(4) 

(3) 

(3) 

(4) 

(3) 

(3) 

(3) 

(2) 

(3) 

(2) 

(3) 

(3) 

(4) 

(3) 

(5) 

(3) 

(3) 

curriculum 


NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree.  Percentages  represent  the  sum  of  the  agree  and  strongly 
agree  responses. 
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Table  B.5 

Teachers  Agreeing  with  Statements  Regarding  State  Science  Assessments 


California 

.  %  (SE) 

Georgia, 

LU 

l/) 

vP 

0s 

2004 

2005 

2006 

2004 

2005 

2006 

Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

The  state  science  assessment 

Is  a  good  measure  of 

28 

22 

21 

30 

23 

22 

46 

43 

46 

47 

54 

40 

students'  mastery  of 
content  standards 

(7) 

(16) 

(8) 

(10) 

(5) 

(10) 

(4) 

(4) 

(3) 

(4) 

(3) 

(3) 

Is  too  difficult  for  the 

61 

86 

64 

73 

74 

75 

40 

52 

43 

45 

42 

34 

majority  of  my  students 

(8) 

(9) 

(7) 

(18) 

(5) 

(15) 

(3) 

(4) 

(3) 

(3) 

(4) 

(3) 

Includes  considerable 

37 

52 

44 

54 

52 

78 

32 

33 

33 

39 

29 

31 

content  that  is  not  in 
our  curriculum 

(10) 

(7) 

(7) 

(10) 

(7) 

(10) 

(3) 

(4) 

(3) 

(3) 

(2) 

(3) 

Omits  considerable 

26 

18 

36 

28 

39 

24 

29 

43 

28 

45 

25 

40 

content  that  is  in  our 
curriculum 

(8) 

(12) 

(7) 

(10) 

(5) 

(10) 

(3) 

(4) 

(2) 

(3) 

(3) 

(3) 

NOTES:  Pennsylvania  is  omitted  from  this  table  because  that  state  did  not  have  science  assessments 
during  these  years.  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.6 

Elementary  School  Principals  Reporting  That  State  Test  Results  Are  Available  and  Useful 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Results 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Reports  of  last  year's 

100 

87 

98 

81 

100 

91 

91 

88 

98 

92 

100 

100 

96 

79 

96 

84 

100 

82 

test  results  for  the 

(NA) 

(8) 

(D 

(8) 

(NA) 

(5) 

(4) 

(5) 

(2) 

(4) 

(NA) 

(0) 

(2) 

(7) 

(3) 

(8) 

(NA) 

(7) 

students  at  your 
school  last  year 

Reports  of  last  year's 

95 

86 

100 

86 

96 

93 

100 

95 

98 

98 

100 

100 

96 

81 

99 

93 

100 

89 

test  results  for  the 

(3) 

(9) 

(NA) 

(8) 

(3) 

(4) 

(NA) 

(4) 

(2) 

(2) 

(NA) 

(0) 

(3) 

(7) 

(D 

(4) 

(NA) 

(5) 

students  at  your 
school  this  year 

Test  results 

100 

70 

100 

72 

100 

95 

100 

92 

92 

91 

98 

97 

96 

64 

100 

59 

98 

74 

summarized  for  each 
student  subgroup 

(NA) 

(7) 

(NA) 

(9) 

(NA) 

(3) 

(NA) 

(4) 

(4) 

(4) 

(2) 

(2) 

(3) 

(8) 

(NA) 

(8) 

(2) 

(8) 

Test  results 

97 

79 

88 

71 

91 

91 

97 

79 

96 

94 

93 

93 

98 

79 

100 

85 

99 

93 

summarized  by 
subtopic  or  skill 

(2) 

(9) 

(8) 

(10) 

(5) 

(6) 

(3) 

(4) 

(3) 

(3) 

(4) 

(4) 

(2) 

(8) 

(NA) 

(8) 

(D 

(4) 

NOTES:  Response  options  included  not  available,  available  and  not  useful,  available  and  minimally  useful,  available  and  moderately  useful,  and 
available  and  very  useful.  Percentages  for  useful  represent  the  sum  of  moderately  useful  and  very  useful  responses  from  principals  who  said  that  the 
test  results  were  available. 
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Table  B.7 

Middle  School  Principals  Reporting  That  State  Test  Results  Are  Available  and  Useful 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Results 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Reports  of  last  year's 

95 

93 

93 

74 

100 

78 

97 

75 

98 

89 

100 

97 

83 

73 

81 

77 

100 

78 

test  results  for  the 

(5) 

(6) 

(7) 

(11) 

(NA) 

(14) 

(2) 

(8) 

(D 

(6) 

(NA) 

(3) 

(14) 

(14) 

(16) 

(16) 

(NA) 

(9) 

students  at  your 
school  last  year 

Reports  of  last  year's 

98 

98 

100 

92 

100 

89 

88 

75 

100 

92 

100 

100 

87 

65 

100 

72 

90 

78 

test  results  for  the 

(2) 

(2) 

(NA) 

(4) 

(NA) 

(6) 

(6) 

(8) 

(NA) 

(5) 

(NA) 

(0) 

(8) 

(14) 

(NA) 

(16) 

(7) 

(10) 

students  at  your 
school  this  year 

Test  results 

100 

96 

100 

89 

100 

92 

98 

84 

96 

89 

100 

93 

100 

56 

100 

59 

100 

78 

summarized  for  each 
student  subgroup 

(NA) 

(4) 

(NA) 

(7) 

(NA) 

(6) 

(2) 

(7) 

(3) 

(6) 

(NA) 

(5) 

(NA) 

(14) 

(NA) 

(14) 

(NA) 

(9) 

Test  results 

96 

94 

96 

81 

99 

91 

95 

86 

94 

87 

83 

83 

100 

81 

100 

84 

100 

87 

summarized  by 
subtopic  or  skill 

(3) 

(4) 

(3) 

(8) 

(D 

(6) 

(3) 

(7) 

(4) 

(6) 

(10) 

(10) 

(NA) 

(9) 

(NA) 

(9) 

(NA) 

(7) 

NOTES:  Response  options  included  not  available,  available  and  not  useful,  available  and  minimally  useful,  available  and  moderately  useful,  and 
available  and  very  useful.  Percentages  for  useful  represent  the  sum  of  moderately  useful  and  very  useful  responses  from  principals  who  said 
that  the  test  results  were  available. 


Table  B.8 

Elementary  School  Teachers  Reporting  That  Mathematics  and  Science  State  Test  Results  Are  Available  and  Useful 


California,  %  (SE) 

Georgia 

,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Results 

Avail 

Useful 

Avail 

Useful  Avail 

Useful 

Avail 

Useful 

Avail 

Useful 

Avail 

Useful 

Avail 

Useful 

Avail 

Useful 

Avail 

Useful 

Math  teachers 

Mathematics  test 

83 

29 

86 

36 

90 

39 

56 

8 

88 

51 

89 

53 

71 

29 

81 

27 

81 

29 

results  summarized 
by  student  subgroup 

(3) 

(3) 

(2) 

(4) 

(2) 

(5) 

(3) 

(4) 

(2) 

(3) 

(2) 

(3) 

(4) 

(2) 

(3) 

(2) 

(3) 

(3) 

Mathematics  test 

80 

75 

87 

68 

89 

69 

64 

70 

94 

80 

96 

85 

82 

68 

82 

66 

84 

61 

results  disaggregated 
by  subtopic/skill 

(4) 

(4) 

(2) 

(3) 

(2) 

(4) 

(3) 

(3) 

(D 

(2) 

(D 

(2) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

Science  teachers 

Science  test  results 

14 

20 

27 

17 

42 

13 

35 

29 

73 

35 

77 

37 

NA 

NA 

NA 

NA 

NA 

NA 

summarized  by 
student  subgroup 

(2) 

(13) 

(4) 

(5) 

(4) 

(4) 

(4) 

(6) 

(3) 

(3) 

(2) 

(3) 

Science  test  results 

14 

37 

28 

25 

41 

28 

37 

53 

78 

55 

83 

59 

NA 

NA 

NA 

NA 

NA 

NA 

disaggregated  by 
subtopic/skill 

(2) 

(14) 

(5) 

(8) 

(3) 

(5) 

(4) 

(4) 

(3) 

(3) 

(2) 

(3) 

NOTES:  Response  options  included  not  available,  available  and  not  useful,  available  and  minimally  useful,  available  and  moderately  useful,  and 
available  and  very  useful.  Percentages  for  useful  represent  the  sum  of  moderately  useful  and  very  useful  responses  from  teachers  who  said  that  the 
test  results  were  available.  Georgia  tested  students  in  all  grades  in  math  and  science.  California  and  Pennsylvania  did  not  test  students  in  some  grades, 
but  percentages  include  all  teachers  who  reported  that  the  resource  was  available,  regardless  of  grade  level. 
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Table  B.9 

Middle  School  Teachers  Reporting  Availability  and  Usefulness  of  Mathematics  and  Science  State  Test  Results 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Results 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Avlb 

Usfl 

Math  teachers 

Mathematics  test 

86 

38 

89 

30 

91 

34 

76 

37 

82 

56 

89 

56 

77 

23 

79 

27 

80 

27 

results  summarized 
by  student  subgroup 

(4) 

(5) 

(3) 

(5) 

(3) 

(5) 

(2) 

(4) 

(3) 

(4) 

(2) 

(3) 

(4) 

(4) 

(5) 

(4) 

(4) 

(6) 

Mathematics  test 

85 

71 

82 

59 

88 

63 

85 

74 

90 

83 

92 

83 

81 

71 

75 

65 

81 

59 

results  disaggregated 
by  subtopic/skill 

(4) 

(4) 

(2) 

(4) 

(4) 

(5) 

(2) 

(4) 

(3) 

(2) 

(2) 

(2) 

(4) 

(7) 

(6) 

(7) 

(4) 

(7) 

Science  teachers 

Science  test  results 

15 

23 

20 

21 

21 

16 

53 

41 

77 

51 

80 

47 

NA 

NA 

NA 

NA 

NA 

NA 

summarized  by 
student  subgroup 

(4) 

(19) 

(4) 

(5) 

(5) 

(5) 

(4) 

(5) 

(4) 

(4) 

(3) 

(5) 

Science  test  results 

15 

47 

18 

43 

20 

31 

57 

57 

82 

70 

87 

67 

NA 

NA 

NA 

NA 

NA 

NA 

disaggregated  by 

(4) 

(16) 

(4) 

(8) 

(5) 

(8) 

(4) 

(6) 

(4) 

(2) 

(2) 

(4) 

subtopic/skill 

NOTES:  Response  options  included  not  available,  available  and  not  useful,  available  and  minimally  useful,  available  and  moderately  useful,  and 
available  and  very  useful.  Percentages  for  useful  represent  the  sum  of  moderately  useful  and  very  useful  responses  from  teachers  who  said  that  the 
test  results  were  available.  Georgia  tested  students  in  all  grades  in  math  and  science.  California  and  Pennsylvania  did  not  test  students  in  some  grades, 
but  percentages  include  all  teachers  who  reported  that  the  resource  was  available,  regardless  of  grade  level. 
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Table  B.10 

Principals  and  Teachers  Agreeing  That  They  Receive  State  Test  Results/Performance 
Information  in  a  Timely  Manner 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


Respondent 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Elementary  school 

45 

44 

43 

14 

51 

60 

13 

13 

23 

principals 

(4) 

(8) 

(7) 

(3) 

(5) 

(9) 

(4) 

(6) 

(12) 

Middle  school 

35 

23 

22 

9 

39 

59 

17 

34 

19 

principals 

(8) 

(10) 

(13) 

(6) 

(8) 

(7) 

(5) 

(5) 

(8) 

Elementary  school 

72 

58 

57 

36 

71 

78 

60 

36 

48 

teachers 

(10) 

(5) 

(4) 

(9) 

(3) 

(4) 

(8) 

(5) 

(5) 

Middle  school 

63 

70 

69 

47 

69 

77 

79 

64 

54 

teachers 

(5) 

(3) 

(4) 

(3) 

(3) 

(3) 

(3) 

(3) 

(4) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.11 

Superintendents  Reporting  That  State  Assessment  Data  Are  Useful  for  Decisionmaking 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

Action 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Developing  a  district 

100 

92 

94 

85 

100 

95 

71 

97 

82 

improvement  plan 

(0) 

(4) 

(6) 

(9) 

(0) 

(5) 

(11) 

(2) 

(11) 

Focusing  principal 

96 

94 

100 

85 

91 

89 

and/or  teacher  PD 

(3) 

(6) 

(0) 

(9) 

(5) 

(8) 

Helping  individual 

100 

88 

97 

94 

100 

95 

67 

86 

90 

schools  to  develop 
school  improvement 
plans 

(0) 

(7) 

(3) 

(6) 

(0) 

(5) 

(8) 

(9) 

(8) 

Making  changes 

100 

89 

99 

89 

90 

90 

97 

92 

88 

to  the  district's 
curriculum  and 
instructional 
materials 

(0) 

(6) 

(D 

(7) 

(6) 

(6) 

(2) 

(4) 

(9) 

Recommending 

68 

65 

69 

80 

80 

75 

specific  instructional 
strategies 

(11) 

(10) 

(13) 

(10) 

(10) 

(11) 

Making  policies 

58 

64 

68 

52 

76 

78 

44 

72 

52 

regarding  how  much 
time  is  spent  on  each 
academic  subject 

(14) 

(11) 

(10) 

(14) 

(10) 

(10) 

(12) 

(12) 

(14) 

Allocating  resources 

59 

59 

52 

80 

53 

55 

among  schools 

(11) 

(11) 

(14) 

(10) 

(15) 

(13) 

NOTES:  Response  options  included  not  useful,  minimally  useful,  moderately  useful,  and  very  useful. 
Percentages  represent  the  sum  of  the  moderately  useful  and  very  useful  responses. 


Table  B.12 

Principals  Reporting  That  State  Assessment  Data  Are  Useful  for  Decisionmaking 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Action 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Developing  a  school 

84 

86 

79 

77 

98 

87 

97 

95 

100 

94 

94 

100 

75 

86 

70 

88 

70 

95 

improvement  plan 

(7) 

(8) 

(8) 

(8) 

(D 

(8) 

(3) 

(4) 

(0) 

(5) 

(4) 

(0) 

(7) 

(7) 

(9) 

(7) 

(9) 

(3) 

Focusing  teacher  PD 

75 

65 

73 

72 

86 

65 

71 

80 

86 

83 

88 

87 

75 

53 

78 

71 

65 

83 

(6) 

(7) 

(9) 

(9) 

(6) 

(4) 

(7) 

(6) 

(5) 

(7) 

(5) 

(6) 

(6) 

(3) 

(8) 

(6) 

(9) 

(7) 

Making  changes 

76 

87 

69 

90 

94 

85 

85 

81 

78 

83 

85 

84 

69 

71 

82 

89 

70 

86 

to  curriculum 
and  instructional 
materials 

(7) 

(7) 

(10) 

(5) 

(5) 

(6) 

(6) 

(7) 

(5) 

(7) 

(7) 

(6) 

(7) 

(14) 

(6) 

(7) 

(10) 

(7) 

Identifying  students 

77 

94 

73 

85 

81 

92 

94 

97 

96 

94 

97 

100 

60 

64 

63 

65 

70 

75 

who  need  additional 
instructional  support 

(11) 

(5) 

(10) 

(8) 

(6) 

(4) 

(6) 

(2) 

(3) 

(5) 

(2) 

(0) 

(9) 

(14) 

(9) 

(15) 

(9) 

(9) 

Making  decisions  on 

55 

66 

53 

70 

56 

62 

70 

61 

71 

66 

79 

72 

60 

38 

47 

49 

53 

46 

how  much  time  is 
spent  on  each  subject 

(14) 

(10) 

(12) 

(11) 

(11) 

(10) 

(9) 

(9) 

(8) 

(10) 

(8) 

(9) 

(11) 

(11) 

(9) 

(14) 

(9) 

(12) 

Identifying  teacher 

25 

39 

47 

63 

69 

43 

70 

52 

78 

60 

76 

73 

32 

28 

39 

36 

33 

20 

strengths  and 
weaknesses 

(12) 

(9) 

(11) 

(9) 

(8) 

(12) 

(8) 

(9) 

(6) 

(10) 

(6) 

(8) 

(8) 

(11) 

(9) 

(11) 

(8) 

(8) 

Making  decisions 

44 

58 

45 

57 

60 

73 

76 

65 

79 

76 

90 

88 

25 

23 

22 

36 

27 

24 

regarding  student 
promotion  or 
retention 

(14) 

(8) 

(12) 

(12) 

(8) 

(10) 

(9) 

(9) 

(7) 

(8) 

(6) 

(7) 

(8) 

(9) 

(8) 

(12) 

(8) 

(9) 

Assigning  students  to 

36 

30 

7 

47 

23 

54 

47 

53 

57 

62 

62 

65 

12 

9 

10 

26 

10 

30 

teachers 

(13) 

(8) 

(3) 

(11) 

(8) 

(10) 

(8) 

(9) 

(7) 

(10) 

(7) 

(10) 

(5) 

(4) 

(5) 

(10) 

(5) 

(11) 

NOTES:  Response  options  included  not  useful,  minimally  useful,  moderately  useful,  and  very  useful.  Percentages  represent  the  sum  of  the  moderately 
useful  and  very  useful  responses. 
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Table  B.13 

Mathematics  and  Science  Teachers  Agreeing  with  Statements  About  the  State  Tests 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Math  teachers 

State  test  results 

77 

65 

70 

54 

73 

62 

81 

71 

89 

79 

89 

79 

70 

68 

69 

60 

62 

57 

allowed  me  to 

(3) 

(4) 

(4) 

(4) 

(3) 

(5) 

(3) 

(3) 

(D 

(2) 

(2) 

(2) 

(4) 

(7) 

(4) 

(5) 

(4) 

(5) 

identify  areas 
where  1  need  to 

strengthen  my 
content  knowledge 
or  teaching  skills 

State  test  results 

67 

62 

63 

53 

67 

60 

77 

71 

85 

84 

88 

80 

69 

77 

63 

58 

56 

61 

helped  me  identify 
and  correct  gaps 
in  curriculum  and 
instruction 

(4) 

(5) 

(4) 

(4) 

(3) 

(6) 

(3) 

(3) 

(2) 

(2) 

(2) 

(3) 

(3) 

(6) 

(3) 

(4) 

(4) 

(4) 

State  test  results 

52 

35 

54 

35 

59 

42 

70 

65 

84 

78 

85 

79 

28 

56 

40 

50 

36 

42 

helped  me  tailor 
instruction  to 
individual  student 
needs 

(3) 

(5) 

(4) 

(4) 

(3) 

(7) 

(3) 

(4) 

(2) 

(3) 

(2) 

(3) 

(4) 

(5) 

(4) 

(5) 

(3) 

(6) 

Science  teachers 

State  test  results 

53 

26 

46 

48 

57 

50 

77 

72 

83 

79 

85 

74 

NA 

NA 

NA 

NA 

NA 

NA 

allowed  me  to 

(13) 

(18) 

(8) 

(11) 

(8) 

(24) 

(4) 

(4) 

(2) 

(2) 

(2) 

(3) 

identify  areas 
where  I  need  to 
strengthen  my 
content  knowledge 
or  teaching  skills 


92  Pain  and  Gain:  Implementing  No  Child  Left  Behind  in  Three  States,  2004-2006 


Table  B.13 — Continued 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

State  test  results 

53 

13 

38 

54 

47 

31 

75 

65 

79 

74 

83 

73 

NA 

NA 

NA 

NA 

NA 

NA 

helped  me  identify 
and  correct  gaps 
in  curriculum  and 
instruction 

(13) 

(9) 

(7) 

(12) 

(6) 

(12) 

(3) 

(4) 

(2) 

(3) 

(2) 

(3) 

State  test  results 

24 

13 

30 

41 

42 

8 

65 

52 

72 

58 

74 

64 

NA 

NA 

NA 

NA 

NA 

NA 

helped  me  tailor 

(11) 

(9) 

(6) 

(11) 

(8) 

(7) 

(4) 

(5) 

(3) 

(4) 

(3) 

(4) 

instruction  to 
individual  student 
needs 


NOTES:  Teachers  who  said  that  they  did  not  receive  test  results  are  excluded.  Only  teachers  in  grades  in  which  state  tests  were  administered  in  2004- 
2005  are  included.  In  Pennsylvania  these  grade  levels  were  3,  5,  and  8.  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly 
agree.  Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.14 

Districts  Requiring  Some  or  All  Elementary  and  Middle  Schools  to  Administer 
Progress  Tests 


School  Type 

California,  %  (SE) 

Georgia 

i,  %  (SE) 

Pennsylvania,  %  (SE) 

2005 

2006 

2005 

2006 

2005 

2006 

Math  progress  tests  required  at  some  or  all 

Elementary  schools 

44 

54 

89 

73 

38 

64 

(13) 

(12) 

(6) 

(11) 

(14) 

(14) 

Middle  schools 

56 

65 

89 

72 

32 

53 

(14) 

(12) 

(6) 

(11) 

(13) 

(14) 

Science  progress  tests  required  at  some  or  all 

Elementary  schools 

9 

16 

55 

55 

0 

6 

(4) 

(8) 

(14) 

(13) 

(NA) 

(6) 

Middle  schools 

17 

27 

43 

65 

0 

6 

(8) 

(11) 

(14) 

(12) 

(NA) 

(6) 

Table  B.15 

Teachers  Required  to  Administer  Mathematics  and  Science  Progress  Tests 


Subject 

California,  %  (SE) 

Georgia 

,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Mathematics 

56 

31 

62 

42 

67 

51 

73 

55 

77 

62 

81 

63 

30 

28 

47 

50 

56 

60 

(8) 

(6) 

(6) 

(8) 

(7) 

(10) 

(4) 

(5) 

(5) 

(5) 

(4) 

(6) 

(5) 

(6) 

(6) 

(14) 

(6) 

(12) 

Science 

6 

2 

9 

11 

8 

9 

23 

37 

30 

44 

26 

46 

3 

3 

3 

10 

3 

6 

(D 

(3) 

(4) 

(4) 

(4) 

(5) 

(5) 

(6) 

(6) 

(6) 

(7) 

(D 

(D 

(D 

(4) 

(D 

(2) 

NOTE:  Response  options  included  yes  and  no. 
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Table  B.16 

Mathematics  Teachers'  Responses  to  Statements  About  Progress  Tests 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

District  or  school 

56 

31 

62 

42 

67 

51 

73 

55 

77 

62 

81 

63 

30 

28 

47 

50 

56 

60 

requires  you  to 
administer  a  progress 
test3 

(8) 

(6) 

(6) 

(8) 

(7) 

(10) 

(4) 

(5) 

(5) 

(5) 

(4) 

(6) 

(5) 

(6) 

(6) 

(14) 

(6) 

(12) 

Progress  tests 

60 

44 

57 

59 

63 

62 

25 

25 

35 

28 

42 

39 

46 

51 

51 

34 

43 

45 

administered  two  to 
three  times  per  yearb 

(9) 

(7) 

(7) 

(9) 

(8) 

(12) 

(5) 

(4) 

(6) 

(5) 

(6) 

(6) 

(8) 

(9) 

(6) 

(4) 

(5) 

(11) 

Progress  tests 

35 

45 

30 

21 

24 

20 

65 

59 

54 

65 

50 

53 

21 

32 

32 

38 

41 

34 

administered 
approximately  every 
six  to  eight  weeksb 

(9) 

(9) 

(7) 

(7) 

(7) 

(8) 

(5) 

(5) 

(6) 

(5) 

(5) 

(7) 

(5) 

(9) 

(4) 

(4) 

(5) 

(7) 

Progress  tests 

5 

10 

13 

20 

13 

17 

11 

16 

10 

7 

8 

8 

33 

17 

17 

28 

17 

21 

administered 
approximately  every 
two  to  four  weeksb 

(3) 

(8) 

(5) 

(6) 

(6) 

(8) 

(3) 

(4) 

(2) 

(2) 

(2) 

(3) 

(6) 

(7) 

(4) 

(6) 

(4) 

(9) 

Results  are  available 

20 

46 

35 

53 

26 

39 

66 

63 

57 

56 

50 

47 

56 

56 

56 

49 

34 

20 

the  same  or  next 
dayc,d 

(6) 

(13) 

(6) 

(8) 

(6) 

(6) 

(5) 

(6) 

(6) 

(6) 

(6) 

(5) 

(6) 

(11) 

(6) 

(11) 

(5) 

(12) 

Results  are  available 

38 

37 

30 

24 

9 

5 

20 

22 

25 

24 

9 

21 

21 

20 

24 

28 

7 

7 

within  one  weekc,e 

(6) 

(12) 

(5) 

(8) 

(3) 

(3) 

(3) 

(4) 

(4) 

(3) 

(D 

(4) 

(4) 

(8) 

(4) 

(6) 

(2) 

(2) 

There  are 

5 

1 

3 

6 

4 

6 

5 

13 

9 

7 

8 

7 

6 

4 

4 

7 

3 

3 

consequences  for 
teachers  associated 

(4) 

(D 

(D 

(2) 

(3) 

(4) 

(2) 

(4) 

(3) 

(3) 

(3) 

(2) 

(2) 

(2) 

(2) 

(3) 

(D 

(D 

with  performance  on 
the  testsf 

a  Response  options  included  yes  and  no. 

b  Response  options  included  two  to  three  times  per  year,  approximately  every  six  to  eight  weeks,  and  approximately  every  two  to  four  weeks. 
c  Response  options  included  the  same  day  administered,  the  next  day,  within  one  week,  two  to  four  weeks  later,  more  than  four  weeks  later,  and  the 
scores  are  not  available  to  me. 

d  Percentages  represent  the  sum  of  the  same  day  and  next  day  responses. 
e  Percentages  represent  within  one  week  responses. 

f  Response  options  included  yes,  no,  and  don't  know.  Percentages  represent  yes  responses. 
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Table  B.17 

Elementary  School  Teachers  Agreeing  with  Statements  About  Tests 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

Statement 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

State  test 

Mathematics  tests  are  a  good 

38 

42 

42 

56 

60 

59 

38 

45 

50 

measure  of  students'  mastery 
of  state  content  standards 

(3) 

(3) 

(4) 

(3) 

(2) 

(3) 

(4) 

(4) 

(4) 

Mathematics  test  results  help 

67 

63 

67 

77 

85 

88 

69 

63 

56 

me  identify  and  correct  gaps 
in  curriculum  and  instruction 

(4) 

(4) 

(3) 

(3) 

(2) 

(2) 

(3) 

(3) 

(4) 

Progress  test 

Mathematics  tests  are  a  good 

48 

57 

62 

73 

62 

69 

74 

70 

70 

measure  of  students'  mastery 
of  state  content  standards 

(5) 

(5) 

(4) 

(3) 

(4) 

(3) 

(4) 

(3) 

(3) 

Mathematics  test  results  help 

78 

76 

81 

82 

76 

85 

87 

84 

84 

me  identify  and  correct  gaps 
in  curriculum  and  instruction 

(5) 

(5) 

(4) 

(3) 

(3) 

(2) 

(3) 

(3) 

(3) 

NOTES:  The  results  displayed  for  "state  test"  include  responses  from  teachers  in  grades  in  which 
state  tests  were  administered  in  2004-2005  and  who  reported  having  access  to  these  results.  For 
Pennsylvania,  this  included  only  teachers  in  grades  3  and  5.  The  results  displayed  for  "progress 
test"  include  only  teachers  who  reported  being  required  to  administer  progress  tests.  Percentages 
represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.18 

Middle  School  Teachers  Agreeing  with  Statements  About  Tests 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

Statement 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

State  test 

Mathematics  tests  are  a  good 

39 

38 

47 

55 

57 

57 

36 

50 

42 

measure  of  students'  mastery 
of  state  content  standards 

(5) 

(4) 

(3) 

(3) 

(3) 

(3) 

(7) 

(4) 

(8) 

Mathematics  test  results  help 

62 

53 

60 

71 

84 

80 

77 

58 

61 

me  identify  and  correct  gaps 
in  curriculum  and  instruction 

(5) 

(4) 

(6) 

(3) 

(2) 

(3) 

(6) 

(4) 

(4) 

Progress  test 

Mathematics  tests  are  a  good 

48 

59 

69 

68 

68 

69 

39 

69 

64 

measure  of  students'  mastery 
of  state  content  standards 

(11) 

(5) 

(5) 

(5) 

(4) 

(3) 

(9) 

(5) 

(3) 

Mathematics  test  results  help 

67 

76 

75 

76 

82 

81 

61 

86 

76 

me  identify  and  correct  gaps 
in  curriculum  and  instruction 

(9) 

(5) 

(3) 

(5) 

(3) 

(3) 

(7) 

(4) 

(5) 

NOTES:  The  results  displayed  for  "state  test"  include  responses  from  teachers  in  grades  in  which 
state  tests  were  administered  in  2004-2005  and  who  reported  having  access  to  these  results.  For 
Pennsylvania,  this  included  only  teachers  in  grades  3  and  5.  The  results  displayed  for  "progress 
test"  include  only  teachers  who  reported  being  required  to  administer  progress  tests.  Percentages 
represent  the  sum  of  the  agree  and  strongly  agree  responses. 
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Table  B.19 

Superintendents,  Principals,  and  Teachers  Agreeing  with  Statements  About 
Understanding  AYP  and  the  State  Accountability  System 


Statement 

California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

1  have  a  clear  understanding  of  AYP  criteria 

Superintendents 

80 

77 

100 

(14) 

(12) 

(0) 

Elementary  school  principals 

78 

92 

99 

97 

100 

96 

95 

96 

93 

(9) 

(4) 

(D 

(2) 

(0) 

(4) 

(4) 

(4) 

(4) 

Middle  school  principals 

91 

95 

96 

89 

88 

100 

99 

94 

87 

(5) 

(4) 

(3) 

(5) 

(6) 

(0) 

(D 

(6) 

(8) 

The  district  and/or  state  helps  me  to  understand  the  state  accountability  system  requirements 


Elementary  school  principals 

85 

81 

93 

84 

86 

91 

83 

84 

96 

(10) 

(9) 

(5) 

(5) 

(4) 

(4) 

(7) 

(9) 

(3) 

Middle  school  principals 

92 

82 

85 

77 

81 

100 

88 

99 

80 

(6) 

(8) 

(6) 

(8) 

(6) 

(0) 

(6) 

(D 

(5) 

The  state's  accountability  system  is  so  complicated,  it  is  hard  for  me  to  understand 


Elementary  school  teachers 

54 

52 

42 

50 

39 

36 

56 

45 

43 

(5) 

(4) 

(3) 

(3) 

(2) 

(2) 

(3) 

(3) 

(2) 

Middle  school  teachers 

56 

55 

58 

46 

44 

42 

54 

48 

41 

(4) 

(4) 

(4) 

(2) 

(2) 

(2) 

(4) 

(3) 

(5) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.20 

Superintendents  and  Principals  Agreeing  That  District/School  AYP  Status  Accurately 
Reflects  Overall  Student  Performance 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


Respondent 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Superintendents 

48 

(14) 

60 

(12) 

41 

(11) 

14 

(8) 

44 

(14) 

40 

(13) 

27 

(11) 

30 

(14) 

51 

(13) 

Middle  school  principals 

43 

(11) 

55 

(12) 

60 

(9) 

32 

(7) 

46 

(8) 

48 

(9) 

22 

(9) 

43 

(13) 

34 

(11) 

Elementary  school  principals 

56 

(14) 

63 

(10) 

60 

(11) 

68 

(6) 

77 

(6) 

86 

(6) 

44 

(11) 

62 

(10) 

69 

(8) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.21 

Administrators  Agreeing  That  District/School  AYP  Status  Accurately  Reflects  Overall  Student  Performance,  by  District/School  AYP 
Status 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Did 

Did 

Did 

Did 

Did 

Did 

Did 

Did 

Did 

Not 

Not 

Not 

Not 

Not 

Not 

Not 

Not 

Not 

Met  Meet 

Met  Meet 

Met  Meet 

Met  Meet 

Met  Meet 

Met  Meet 

Met  Meet 

Met  Meet 

Met  Meet 

Respondent 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

AYP 

District 

49 

64 

68 

0 

47 

29 

28 

6 

93 

12 

66 

20 

37 

17 

47 

0 

53 

19 

superintendents 

(17) 

(26) 

(12) 

(NA) 

(14) 

(16) 

(28) 

(6) 

(6) 

(7) 

(18) 

(11) 

(16) 

(13) 

(18) 

(NA) 

(14) 

(18) 

Principals 

55 

39 

67 

47 

72 

38 

70 

12 

80 

2 

87 

10 

43 

22 

61 

0 

66 

11 

(12) 

(6) 

(12) 

(16) 

(9) 

(10) 

(6) 

(5) 

(5) 

(2) 

(4) 

(5) 

(11) 

(13) 

(8) 

(NA) 

(7) 

(8) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree.  Percentages  represent  the  sum  of  the  agree  and  strongly 
agree  responses. 
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Table  B.22 

Administrators  Agreeing  That  Their  District/School  Would  Meet  AYP  Targets  for  the  Next 
School  Year 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


Respondent 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

District  superintendents 

85 

88 

76 

50 

69 

89 

74 

58 

79 

(13) 

(6) 

(10) 

(14) 

(11) 

(6) 

(11) 

(15) 

(10) 

Elementary  school  principals 

89 

72 

91 

97 

100 

93 

89 

93 

95 

(10) 

(9) 

(5) 

(2) 

(0) 

(4) 

(6) 

(4) 

(3) 

Middle  school  principals 

77 

66 

75 

69 

92 

88 

89 

74 

69 

(11) 

(10) 

(9) 

(9) 

(4) 

(6) 

(6) 

(17) 

(14) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.23 

Administrators  Agreeing  That  Their  District/School  Would  Meet  AYP  Targets  in  the  Next 
Five  School  Years 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


Respondent 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

District  superintendents 

35 

29 

22 

45 

35 

59 

40 

39 

54 

(13) 

(12) 

(9) 

(13) 

(13) 

(13) 

(13) 

(15) 

(14) 

Elementary  school  principals 

44 

44 

58 

80 

87 

87 

55 

51 

52 

(13) 

(11) 

(11) 

(6) 

(6) 

(6) 

(10) 

(10) 

(7) 

Middle  school  principals 

56 

44 

33 

65 

71 

60 

43 

49 

47 

(8) 

(10) 

(9) 

(8) 

(8) 

(8) 

(13) 

(15) 

(13) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.24 

Principals  Employing  School  Improvement  Strategies 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Strategy 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Matching  curriculum 

99 

96 

100 

100 

95 

98 

99 

94 

97 

100 

100 

100 

99 

100 

100 

99 

100 

100 

and  instruction  with 
standards  and/or 
assessments 

(D 

(4) 

(0) 

(0) 

(5) 

(2) 

(D 

(4) 

(3) 

(0) 

(0) 

(0) 

(D 

(0) 

(0) 

(D 

(0) 

(0) 

Using  existing 

98 

92 

100 

94 

95 

85 

96 

95 

100 

99 

100 

99 

93 

100 

94 

94 

88 

90 

research  to  inform 
decisions  about 

(2) 

(6) 

(0) 

(5) 

(3) 

(8) 

(3) 

(4) 

(0) 

(D 

(0) 

(D 

(5) 

(5) 

(0) 

(5) 

(7) 

(6) 

improvement 

strategies 

Providing  additional 

96 

95 

100 

98 

98 

100 

99 

98 

97 

97 

85 

90 

instruction  to  low- 
performing  students 

(3) 

(3) 

(0) 

(2) 

(2) 

(0) 

(D 

(2) 

(2) 

(3) 

(7) 

(6) 

Increasing  the  use  of 

99 

100 

93 

100 

90 

98 

100 

96 

100 

94 

100 

98 

99 

95 

91 

100 

100 

92 

student  achievement 
data  to  inform 
instruction 

(D 

(0) 

(7) 

(0) 

(6) 

(2) 

(0) 

(4) 

(0) 

(5) 

(0) 

(2) 

(D 

(5) 

(7) 

(0) 

(0) 

(7) 

Increasing  the 

84 

72 

89 

90 

93 

80 

96 

83 

95 

96 

95 

96 

85 

70 

64 

94 

71 

72 

quantity  of  teacher 

PD 

(8) 

(8) 

(5) 

(6) 

(4) 

(10) 

(2) 

(6) 

(3) 

(3) 

(3) 

(4) 

(7) 

(14) 

(9) 

(4) 

(9) 

(10) 

Improving  the  school 

87 

96 

74 

85 

94 

83 

100 

94 

100 

84 

100 

94 

77 

100 

81 

99 

73 

72 

planning  process 

(7) 

(4) 

(10) 

(8) 

(5) 

(8) 

(0) 

(4) 

(0) 

(7) 

(0) 

(3) 

(8) 

(0) 

(6) 

(D 

(9) 

(15) 

Providing  before- 

82 

81 

84 

92 

97 

62 

90 

97 

86 

86 

93 

95 

65 

70 

77 

59 

69 

63 

or  after-school, 
weekend,  or  summer 
programs 

(9) 

(11) 

(8) 

(6) 

(2) 

(14) 

(5) 

(2) 

(4) 

(5) 

(5) 

(3) 

(11) 

(14) 

(7) 

(15) 

(10) 

(14) 

Promoting  programs 

74 

70 

60 

70 

80 

78 

80 

64 

74 

62 

87 

56 

57 

59 

43 

71 

47 

42 

to  make  the  school 

(10) 

(9) 

(9) 

(10) 

(9) 

(9) 

(6) 

(10) 

(6) 

(9) 

(6) 

(11) 

(8) 

(12) 

(8) 

(11) 

(10) 

(12) 

a  more  attractive 
choice  for  parents 
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Table  B.24 — Continued 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Strategy 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Restructuring  the  day 

63 

53 

62 

36 

75 

43 

67 

49 

79 

53 

79 

59 

54 

31 

61 

43 

73 

38 

to  teach  content  in 

(11) 

(10) 

(9) 

(10) 

(10) 

(13) 

(5) 

(9) 

(7) 

(9) 

(5) 

(11) 

(8) 

(11) 

(9) 

(13) 

(9) 

(12) 

greater  depth  (e.g., 
a  literacy  block) 

Increasing 

8 

23 

31 

12 

58 

35 

42 

23 

26 

20 

20 

24 

instructional  time 

(5) 

(8) 

(7) 

(7) 

(7) 

(8) 

(8) 

(7) 

(9) 

(8) 

(5) 

(9) 

(lengthening  school 
day  or  year  or 
shortening  recess) 

NOTES:  Response  options  included  not  employed,  employed  and  not  useful,  employed  and  minimally  useful,  employed  and  moderately  useful,  and 
employed  and  very  useful.  Percentages  represent  employed  responses. 
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Table  B.25 

Elementary  and  Middle  School  Principals  Identifying  School  Improvement  Strategies  as  Most 
Important 


California  %  (SE) 

Georgia  %  (SE) 

Pennsylvania  %  (SE) 

2005 

2006 

2005 

2006 

2005 

2006 

Strategy 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Matching  curriculum 

58 

57 

53 

47 

62 

46 

55 

65 

63 

59 

51 

59 

and  instruction  with 
standards  and/or 
assessments 

(11) 

(10) 

(9) 

(10) 

(6) 

(8) 

(7) 

(8) 

(9) 

(13) 

(8) 

(11) 

Using  existing 

40 

37 

34 

44 

23 

25 

22 

28 

22 

18 

23 

25 

research  to  inform 
decisions  about 
improvement 
strategies 

(11) 

(11) 

(10) 

(9) 

(5) 

(8) 

(6) 

(10) 

(6) 

(8) 

(6) 

(10) 

Providing  additional 

40 

55 

48 

72 

38 

46 

45 

46 

50 

71 

47 

39 

instruction  to  low 
performing  students 

(11) 

(11) 

(15) 

(9) 

(6) 

(10) 

(9) 

(8) 

(9) 

(10) 

(9) 

(10) 

Increasing  the  use  of 

71 

44 

53 

21 

68 

66 

57 

61 

52 

34 

59 

59 

student  achievement 
data  to  inform 
instruction 

(8) 

(11) 

(9) 

(8) 

(7) 

(9) 

(6) 

(8) 

(11) 

(11) 

(9) 

(11) 

Increasing  the 

36 

25 

31 

35 

23 

21 

42 

30 

25 

19 

18 

31 

quantity  of  teacher 

professional 

development 

(11) 

(9) 

(9) 

(9) 

(5) 

(7) 

(6) 

(9) 

(9) 

(9) 

(5) 

(11) 

Improving  the  school 

2 

16 

11 

17 

22 

32 

25 

29 

17 

22 

9 

15 

planning  process 

(D 

(7) 

(7) 

(9) 

(8) 

(8) 

(7) 

(7) 

(8) 

(10) 

(3) 

(8) 

Providing  before- 

18 

27 

24 

4 

19 

13 

17 

8 

19 

26 

27 

29 

or  after-school, 
weekend,  or  summer 
programs 

(6) 

(10) 

(9) 

(3) 

(6) 

(6) 

(6) 

(3) 

(5) 

(10) 

(8) 

(11) 

Promoting  programs 

0 

21 

11 

13 

3 

14 

4 

5 

2 

19 

7 

12 

to  make  the  school 
a  more  attractive 
choice  for  parents 

(8) 

(6) 

(7) 

(3) 

(8) 

(3) 

(3) 

(D 

(16) 

(3) 

(8) 

Restructuring  the  day 

13 

8 

17 

16 

24 

20 

22 

25 

26 

18 

24 

16 

to  teach  content  in 
greater  depth  (e.g., 
a  literacy  block) 

(8) 

(5) 

(7) 

(7) 

(7) 

(8) 

(6) 

(9) 

(6) 

(9) 

(7) 

(8) 

Increase  instructional 

2 

2 

5 

1 

17 

5 

1 

1 

3 

1 

1 

13 

time  (lengthening 
school  day  or  year  or 
shortening  recess) 

(2) 

(2) 

(4) 

(D 

(5) 

(3) 

(D 

(D 

(3) 

(D 

(D 

(7) 

NOTE:  The  question  was  identify  up  to  three  strategies  that  are  most  important  for  making  your  school 
better. 


Table  B.26 

Principals  Reporting  Test  Preparation  Activities 

California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

2004  2005  2006 

2004  2005  2006 

2004  2005  2006 

Activity 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Helping  teachers 

89 

96 

94 

99 

81 

98 

95 

100 

100 

100 

97 

98 

100 

95 

100 

99 

100 

98 

identify  content  that 
is  likely  to  appear 
on  the  state  test 

(7) 

(4) 

(3) 

(D 

(9) 

(2) 

(3) 

(0) 

(0) 

(0) 

(3) 

(2) 

(0) 

(5) 

(0) 

(D 

(0) 

(2) 

so  they  can  cover  it 
adequately  in  their 
instruction 

Discussing  methods 

76 

99 

94 

95 

94 

99 

100 

100 

100 

100 

99 

100 

100 

100 

99 

100 

100 

100 

for  preparing 
students  for  the  state 

(8) 

(D 

(4) 

(4) 

(5) 

(D 

(0) 

(0) 

(0) 

(0) 

(D 

(0) 

(0) 

(0) 

(D 

(0) 

(0) 

(0) 

test  at  staff  meetings 

Distributing  released 

49 

31 

60 

61 

85 

67 

96 

78 

88 

98 

88 

100 

98 

90 

96 

96 

96 

91 

copies  of  the  state 
test  or  test  items 

(14) 

(10) 

(10) 

(11) 

(8) 

(11) 

(3) 

(7) 

(4) 

(2) 

(5) 

(0) 

(2) 

(7) 

(3) 

(2) 

(3) 

(5) 

Encouraging  teachers 

85 

93 

71 

70 

90 

93 

91 

99 

77 

57 

73 

64 

to  focus  their  efforts 
on  students  close 

(6) 

(3) 

(8) 

(9) 

(4) 

(4) 

(4) 

(D 

(7) 

(15) 

(9) 

(14) 

to  meeting  the 
standards 

Distributing 

41 

36 

59 

61 

57 

54 

87 

73 

90 

88 

89 

94 

75 

89 

93 

88 

79 

92 

commercial  test 

(12) 

(12) 

(10) 

(11) 

(15) 

(13) 

(5) 

(7) 

(5) 

(5) 

(5) 

(3) 

(8) 

(7) 

(4) 

(7) 

(8) 

(5) 

preparation  materials 
(e.g.,  practice  tests) 

Encouraging  or 

52 

44 

53 

63 

45 

63 

53 

55 

44 

66 

51 

50 

39 

46 

61 

45 

64 

44 

requiring  teachers  to 
spend  more  time  on 
tested  subjects  and 
less  on  other  subjects 

(11) 

(8) 

(11) 

(9) 

(7) 

(13) 

(8) 

(9) 

(7) 

(8) 

(8) 

(11) 

(9) 

(13) 

(11) 

(13) 

(8) 

(12) 

Discussing 

NA 

NA 

NA 

NA 

NA 

NA 

NA 

NA 

NA 

NA 

NA 

NA 

100 

100 

100 

assessment  anchors  (0)  (0)  (0) 

with  teachers  (PA 

only) 

NOTE:  Response  options  included  yes  and  no. 
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Table  B.27 

Districts  Taking  Certain  Steps  to  Assist  Schools  with  Aligning  Math  Curriculum  and 
Instruction  with  Standards  in  the  Past  Three  Years 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

Step 

2005 

2006 

2005 

2006 

2005 

2006 

Monitored  or  provided 

98 

81 

93 

70 

82 

70 

feedback  on  the 
implementation  of  state 
standards  in  classrooms 

(2) 

(9) 

(4) 

(12) 

(10) 

(13) 

Mapped  out  the  alignment 

82 

76 

85 

58 

54 

70 

of  required  textbooks  and 
instructional  programs  to 
state  standards 

(11) 

(10) 

(6) 

(13) 

(15) 

(12) 

Mapped  out  the  alignment 

68 

51 

87 

68 

49 

62 

of  required  textbooks  and 
instructional  programs  to 
state  assessments 

(12) 

(11) 

(6) 

(12) 

(15) 

(12) 

Developed  pacing  plan  or 

60 

58 

83 

76 

64 

66 

instructional  calendar  aligned 
with  state  standards 

(12) 

(11) 

(8) 

(11) 

(15) 

(14) 

Established  detailed 

48 

51 

75 

84 

66 

79 

curriculum  guidelines  aligned 
with  state  content  standards 

(11) 

(11) 

(13) 

(11) 

(15) 

(11) 

Provided  sample  lessons  linked 

65 

88 

70 

71 

76 

67 

to  state  standards 

(13) 

(7) 

(13) 

(12) 

(12) 

(13) 

Developed  local  content 

62 

57 

51 

27 

72 

30 

standards  that  augment  state 
content  standards 

(12) 

(11) 

(14) 

(13) 

(15) 

(14) 

NOTES:  Response  options  included  mathematics;  science;  reading,  language  arts,  and  English; 
and  none  of  these  subjects.  We  asked  respondents  to  select  at  least  one  option.  Percentages 
represent  mathematics  responses. 
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Table  B.28 

Districts  Taking  Certain  Steps  to  Assist  Schools  with  Aligning  Science  Curriculum  and 
Instruction  with  Standards  in  the  Past  Three  Years 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

Step 

2005 

2006 

2005 

2006 

2005 

2006 

Monitored  or  provided 

43 

54 

92 

69 

40 

39 

feedback  on  the 
implementation  of  state 
standards  in  classrooms 

(13) 

(11) 

(4) 

(12) 

(14) 

(14) 

Mapped  out  the  alignment 

54 

51 

76 

60 

34 

58 

of  required  textbooks  and 
instructional  programs  to 
state  standards 

(13) 

(12) 

(9) 

(13) 

(14) 

(13) 

Mapped  out  the  alignment 

48 

34 

72 

60 

30 

41 

of  required  textbooks  and 
instructional  programs  to 
state  assessments 

(12) 

(11) 

(10) 

(13) 

(13) 

(13) 

Developed  pacing  plan  or 

24 

24 

72 

67 

32 

29 

instructional  calendar  aligned 
with  state  standards 

(11) 

(10) 

(10) 

(11) 

(12) 

(14) 

Established  detailed 

27 

27 

70 

70 

48 

63 

curriculum  guidelines  aligned 
with  state  content  standards 

(10) 

(10) 

(11) 

(12) 

(14) 

(14) 

Provided  sample  lessons  linked 

38 

49 

67 

69 

32 

41 

to  state  standards 

(12) 

(12) 

(13) 

(12) 

(12) 

(14) 

Developed  local  content 

35 

31 

47 

50 

49 

69 

standards  that  augment  state 
content  standards 

(11) 

(11) 

(14) 

(14) 

(14) 

(14) 

NOTES:  Response  options  included  mathematics;  science;  reading,  language  arts,  and  English; 
and  none  of  these  subjects.  We  asked  respondents  to  select  at  least  one  option.  Percentages 
represent  science  responses. 
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Table  B.29 

Elementary  School  Teachers  Reporting  That  District/State  Actions  to  Align  Math 
Curriculum/Instruction  with  Standards  Were  Useful 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

Action 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Detailed  curriculum  guidelines 

80 

83 

82 

85 

89 

91 

83 

87 

87 

aligned  with  state  standards 

(5) 

(2) 

(3) 

(2) 

(2) 

(2) 

(3) 

(2) 

(2) 

A  "pacing  plan"  or 

70 

77 

83 

89 

84 

82 

"instructional  calendar" 

(4) 

(5) 

(2) 

(2) 

(2) 

(3) 

Monitoring  and  feedback 

57 

56 

51 

69 

63 

72 

61 

58 

64 

on  implementation  of  state 
standards 

(4) 

(5) 

(4) 

(4) 

(3) 

(3) 

(3) 

(4) 

(4) 

Mapping  out  alignment  of 

72 

74 

69 

85 

77 

80 

78 

83 

81 

textbooks  and  instructional 
programs  to  state  standards 

(4) 

(2) 

(4) 

(2) 

(2) 

(2) 

(3) 

(3) 

(3) 

Sample  lesson  aligned  with 

62 

65 

63 

82 

75 

76 

78 

72 

77 

state  standards 

(6) 

(4) 

(5) 

(2) 

(3) 

(3) 

(3) 

(2) 

(3) 

NOTE:  Percentages  represent  the  sum  of  moderately  useful  and  very  useful  responses  from 
teachers  who  said  that  the  action  occurred. 


Table  B.30 

Middle  School  Teachers  Reporting  That  District/State  Actions  to  Align  Math 
Curriculum/Instruction  with  Standards  Were  Useful 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

Action 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Detailed  curriculum  guidelines 

72 

80 

79 

90 

87 

89 

77 

84 

76 

aligned  with  state  standards 

(7) 

(4) 

(3) 

(2) 

(2) 

(2) 

(4) 

(3) 

(5) 

A  "pacing  plan"  or 

67 

78 

81 

85 

73 

69 

"instructional  calendar" 

(7) 

(7) 

(3) 

(2) 

(8) 

(6) 

Monitoring  and  feedback 

62 

52 

49 

64 

61 

71 

60 

51 

56 

on  implementation  of  state 
standards 

(7) 

(6) 

(6) 

(3) 

(3) 

(2) 

(4) 

(5) 

(4) 

Mapping  out  alignment  of 

75 

76 

74 

84 

70 

74 

66 

61 

71 

textbooks  and  instructional 
programs  to  state  standards 

(6) 

(5) 

(5) 

(2) 

(3) 

(3) 

(9) 

(8) 

(4) 

Sample  lesson  aligned  with 

61 

66 

69 

74 

72 

75 

67 

57 

80 

state  standards 

(9) 

(6) 

(6) 

(3) 

(3) 

(3) 

(6) 

(7) 

(5) 

NOTES:  Response  options  included  did  not  occur,  occurred  and  not  useful,  occurred  and 
minimally  useful,  occurred  and  moderately  useful,  and  occurred  and  very  useful.  Percentages 
represent  the  sum  of  moderately  useful  and  very  useful  responses  from  teachers  who  said  that 
the  action  occurred. 


Table  B.31 

Principals  Agreeing  with  Statements  About  District  Support 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

When  schools  are 

77 

84 

66 

91 

78 

77 

81 

86 

83 

82 

79 

88 

80 

83 

86 

69 

77 

78 

having  difficulty, 
the  district  provides 
assistance  needed  to 
help  them  improve 

(10) 

(9) 

(11) 

(6) 

(11) 

(9) 

(6) 

(3) 

(6) 

(4) 

(6) 

(4) 

(7) 

(6) 

(8) 

(16) 

(8) 

(9) 

District  staff  provide 

61 

69 

61 

82 

63 

66 

74 

81 

80 

77 

75 

79 

75 

65 

66 

58 

64 

57 

appropriate  support 
to  enable  principals 
to  act  as  instructional 

(17) 

(17) 

(13) 

(8) 

(11) 

(8) 

(8) 

(4) 

(5) 

(5) 

(6) 

(8) 

(11) 

(13) 

(9) 

(15) 

(9) 

(14) 

leaders 

District  staff 

76 

67 

68 

74 

69 

72 

78 

80 

84 

75 

87 

76 

79 

61 

74 

90 

77 

67 

provide  appropriate 
instructional  support 
for  teachers 

(10) 

(14) 

(12) 

(9) 

(9) 

(9) 

(7) 

(5) 

(5) 

(7) 

(5) 

(9) 

(7) 

(14) 

(8) 

(6) 

(9) 

(14) 

District  staff 

45 

64 

56 

63 

77 

77 

77 

84 

80 

80 

82 

69 

provide  support  for 
teaching  grade-level 
standards  to  special 
education  students 
(i.e.,  students  in  lEPs) 

(11) 

(10) 

(14) 

(10) 

(6) 

(8) 

(7) 

(6) 

(5) 

(9) 

(6) 

(15) 

District  staff  provide 

62 

74 

61 

70 

74 

76 

81 

76 

84 

91 

85 

70 

support  for  teaching 

(11) 

(10) 

(13) 

(8) 

(7) 

(8) 

(7) 

(7) 

(7) 

(4) 

(4) 

(10) 

grade-level  standards 
to  ELLs  (i.e.,  students 
with  LEP) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree.  Percentages  represent  the  sum  of  the  agree  and  strongly 
agree  responses. 
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Table  B.32 

Districts  Providing  Technical  Assistance  to  All  Schools  or  Low-Performing  Schools 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Assistance 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

Assisting  the 

86 

0 

89 

3 

88 

5 

98 

2 

100 

0 

99 

1 

81 

3 

97 

3 

91 

0 

school  in  analyzing 
assessment  data 
to  identify  and 
address  problems  in 
instruction 

(8) 

(NA) 

(8) 

(3) 

(7) 

(3) 

(2) 

(2) 

(NA) 

(NA) 

(D 

(D 

(10) 

(3) 

(3) 

(3) 

(9) 

(NA) 

Assisting  the  school 

86 

0 

89 

11 

74 

13 

100 

0 

98 

0 

96 

4 

78 

0 

97 

3 

78 

5 

in  implementing 
instructional 
strategies  that 
have  been  proven 
effective 

(8) 

(0) 

(9) 

(9) 

(10) 

(2) 

(NA) 

(NA) 

(2) 

(NA) 

(3) 

(3) 

(11) 

(NA) 

(3) 

(3) 

(12) 

(5) 

Assisting  the  school 

86 

0 

65 

16 

67 

6 

53 

0 

74 

4 

70 

2 

39 

1 

54 

0 

34 

1 

in  analyzing  and 
revising  its  budget  to 
use  resources  more 
effectively 

(8) 

(NA) 

(12) 

(10) 

(11) 

(6) 

(14) 

(NA) 

(10) 

(3) 

(13) 

(2) 

(12) 

(D 

(15) 

(NA) 

(13) 

(D 

Helping  the 

86 

0 

87 

2 

81 

6 

85 

15 

95 

5 

97 

3 

59 

7 

63 

19 

59 

7 

school  with  school 

improvement 

planning 

(8) 

(NA) 

(8) 

(2) 

(9) 

(4) 

(10) 

(10) 

(4) 

(4) 

(3) 

(3) 

(12) 

(4) 

(15) 

(14) 

(14) 

(5) 

Helping  schools 

85 

0 

73 

3 

81 

19 

79 

15 

100 

0 

87 

12 

77 

0 

71 

15 

66 

34 

prepare  complete 
and  accurate  data 
to  comply  with 

NCLB  reporting 
requirements 

(9) 

(NA) 

(12) 

(3) 

(9) 

(9) 

(12) 

(11) 

(NA) 

(NA) 

(11) 

(D 

(11) 

(NA) 

(14) 

(14) 

(14) 

(14) 

Helping  the  school 

81 

0 

72 

2 

73 

14 

100 

0 

98 

2 

94 

1 

66 

0 

98 

1 

81 

9 

obtain  additional 

PD  based  on 

(9) 

(0) 

(12) 

(2) 

(10) 

(4) 

(NA) 

(NA) 

(2) 

(2) 

(5) 

(D 

(12) 

(NA) 

(2) 

(D 

(11) 

(9) 

scientifically  based 
research 
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Table  B.32 — Continued 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Assistance 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

All 

Low 

Providing  guidance 

79 

8 

75 

2 

90 

8 

93 

3 

78 

0 

73 

0 

for  teaching  grade- 
level  standards  to 

ELLs  and/or  special 
education  students 

(9) 

(5) 

(10) 

(2) 

(7) 

(7) 

(5) 

(3) 

(11) 

(NA) 

(13) 

(NA) 

Providing  before- 

44 

23 

57 

18 

71 

7 

82 

12 

86 

2 

80 

16 

62 

10 

39 

24 

74 

0 

or  after-school, 
weekend,  or  summer 

(14) 

(14) 

(13) 

(10) 

(10) 

(4) 

(9) 

(7) 

(11) 

(2) 

(10) 

(9) 

(12) 

(8) 

(14) 

(13) 

(12) 

(NA) 

programs 

Providing  additional 

80 

2 

57 

17 

68 

7 

44 

30 

80 

18 

75 

20 

72 

0 

61 

7 

57 

0 

instructional 
materials  and  books 

(9) 

(2) 

(12) 

(9) 

(11) 

(4) 

(13) 

(13) 

(9) 

(9) 

(10) 

(9) 

(12) 

(NA) 

(15) 

(4) 

(14) 

(NA) 

Assisting  the  school 

44 

0 

57 

10 

59 

4 

74 

18 

94 

4 

55 

27 

44 

6 

41 

33 

38 

14 

in  implementing 
parental  involvement 
strategies 

(14) 

(NA) 

(13) 

(6) 

(11) 

(3) 

(12) 

(10) 

(4) 

(4) 

(13) 

(10) 

(12) 

(6) 

(14) 

(15) 

(13) 

(10) 

Helping  the  school 

42 

2 

35 

3 

39 

1 

67 

4 

81 

0 

71 

4 

33 

0 

23 

1 

23 

0 

obtain  more- 
experienced  teachers 

(13) 

(2) 

(13) 

(2) 

(11) 

(D 

(13) 

(3) 

(12) 

(NA) 

(11) 

(3) 

(11) 

(NA) 

(14) 

(D 

(10) 

(NA) 

Assigning  additional 

29 

15 

12 

10 

5 

18 

10 

21 

55 

15 

48 

25 

38 

1 

27 

3 

26 

8 

full-time  school-level 

(11) 

(13) 

(7) 

(5) 

(5) 

(8) 

(6) 

(9) 

(14) 

(7) 

(13) 

(10) 

(12) 

(D 

(12) 

(2) 

(11) 

(8) 

staff  to  support 
teacher  development 

Providing  a  coach  or 

15 

0 

19 

21 

15 

17 

34 

26 

41 

40 

42 

14 

12 

4 

11 

9 

5 

0 

mentor  to  assist  the 

(8) 

(0) 

(8) 

(10) 

(8) 

(7) 

(13) 

(11) 

(14) 

(14) 

(13) 

(7) 

(8) 

(3) 

(9) 

(8) 

(3) 

(NA) 

principal 

NOTE:  Response  options  included  no  schools,  low-performing  schools,  high-performing  schools,  and  all  schools. 
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Table  B.33 

Districts  Requiring  Some  or  All  Elementary  and  Middle  Schools  to 
Offer  Remedial  Assistance  to  Students  Outside  the  School  Day 


School 

California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania 

,  %  (SE) 

2005 

2006 

2005 

2006 

2005 

2006 

Elementary 

61 

72 

84 

86 

95 

87 

(13) 

(11) 

(12) 

(7) 

(4) 

(9) 

Middle 

44 

75 

86 

75 

82 

87 

(12) 

(11) 

(11) 

(12) 

(11) 

(9) 

NOTES:  Response  options  included  none,  some,  and  all  schools.  Percentages 
represent  the  sum  of  the  some  and  all  responses. 


Table  B.34 

Districts  Requiring  Some  or  All  Elementary  and  Middle  Schools  to  Make  Changes  Targeting 
Low-Achieving  Students 


California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania,  %  (SE) 

2005 

2006 

2005 

2006 

2005 

2006 

Change 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Creating  separate 

39 

56 

23 

34 

57 

56 

34 

43 

54 

51 

19 

27 

mathematics  classes 
for  low-achieving 
students 

(13) 

(14) 

(10) 

(11) 

(14) 

(13) 

(13) 

(13) 

(15) 

(15) 

(10) 

(12) 

Increasing  the 

44 

35 

71 

60 

94 

92 

50 

87 

63 

49 

58 

48 

amount  of  time 
spent  on  math 
instruction 
specifically  for  low- 
achieving  students 

(13) 

(13) 

(11) 

(12) 

(4) 

(4) 

(13) 

(7) 

(15) 

(15) 

(14) 

(14) 

Eliminating  some 

53 

76 

22 

61 

19 

21 

43 

66 

11 

32 

20 

21 

remedial  math 
courses  or  instruction 
and  requiring  all 
students  to  take 
more  challenging 
math  courses  or 
instruction 

(14) 

(10) 

(9) 

(11) 

(9) 

(9) 

(14) 

(13) 

(5) 

(12) 

(11) 

(11) 

Increasing  the 

6 

12 

4 

2 

30 

33 

34 

34 

0 

0 

2 

2 

amount  of  time 
spent  on  science 
instruction 
specifically  for  low- 
achieving  students 

(3) 

(7) 

(3) 

(2) 

(14) 

(14) 

(13) 

(13) 

(NA) 

(NA) 

(2) 

(2) 

Requiring  all 

6 

9 

9 

11 

33 

43 

28 

37 

17 

28 

16 

16 

students  to  take 
more-challenging 
science  courses  or 
instruction 

(4) 

(5) 

(9) 

(11) 

(14) 

(14) 

(28) 

(37) 

(14) 

(15) 

(16) 

(16) 

Creating  separate 

2 

4 

2 

2 

3 

16 

13 

13 

8 

8 

0 

0 

science  classes 
for  low-achieving 
students 

(2) 

(3) 

(2) 

(2) 

(2) 

(11) 

(11) 

(11) 

(7) 

(7) 

(NA) 

(NA) 

NOTES:  Response  options  included  none,  some,  and  all  schools.  Percentages  represent  the  sum  of  the 
some  and  all  responses. 


Table  B.35 

Principals  and  Superintendents  Reporting  New  Curricula 


Response 

California,  %  (SE) 

Georgia 

i,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Principal  reports  implementing3 

New  math 

70 

55 

10 

29 

26 

52 

39 

44 

20 

22 

22 

52 

30 

49 

29 

38 

39 

31 

curriculum 

(10) 

(13) 

(5) 

(9) 

(11) 

(12) 

(8) 

(9) 

(5) 

(7) 

(6) 

(10) 

(10) 

(13) 

(10) 

(15) 

(11) 

(10) 

New  science 

26 

46 

14 

24 

6 

16 

41 

20 

9 

8 

6 

60 

42 

45 

16 

17 

32 

21 

curriculum 

(11) 

(13) 

(7) 

(12) 

(4) 

(8) 

(8) 

(8) 

(4) 

(6) 

(3) 

(9) 

(12) 

(13) 

(8) 

(8) 

(9) 

(8) 

Superintendent  reports  requiring  some  or  all  schools  to  adoptb 

New  math 

47 

62 

27 

35 

28 

33 

34 

18 

29 

36 

39 

45 

20 

33 

24 

27 

36 

32 

curriculum 

(14) 

(14) 

(12) 

(13) 

(11) 

(7) 

(12) 

(9) 

(11) 

(13) 

(13) 

(12) 

(10) 

(12) 

(12) 

(12) 

(14) 

(14) 

New  science 

33 

36 

13 

26 

16 

15 

7 

7 

14 

18 

23 

33 

29 

29 

23 

23 

47 

30 

curriculum 

(14) 

(15) 

(9) 

(13) 

(12) 

(8) 

(5) 

(5) 

(8) 

(8) 

(13) 

(12) 

(12) 

(12) 

(14) 

(14) 

(13) 

(13) 

a  Response  options  included  yes  and  no. 

b  Response  options  included  none,  some,  and  all  schools.  Percentages  represent  the  sum  of  the  some  and  all  responses. 
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Table  B.36 

Principals  of  Schools  Identified  as  Needing  Improvement  Reporting  District  or  State 


Assistance 

California 

Georgia 

Pennsylvania 

Type  of  Assistance 

2004 

n=6 

2005 

n=17 

2006 

n=11 

2004 

n=24 

2005 

n=21 

2006 

n=21 

2004 

n=13 

2005  2006 

n=8  n=9 

Additional  PD  or  special  access 
to  PD  resources 

6 

9 

6 

18 

9 

14 

10 

7  5 

Special  grants  to  support 
school  improvement 

5 

7 

3 

12 

10 

14 

8 

7  7 

A  mentor  or  coach  for 
you  (e.g.,  a  distinguished 
educator) 

5 

6 

2 

5 

6 

11 

2 

2  2 

School  support  teams 

2 

3 

3 

9 

8 

10 

4 

4  4 

Additional  full-time  school- 
level  staff  to  support  teacher 
development 

4 

2 

3 

11 

4 

7 

4 

3  1 

Distinguished  teachers 

1 

3 

0 

3 

1 

1 

3 

1  5 

NOTE:  Response  options  included  yes  and  no. 

Table  B.37 

Principals  of  Schools  in  Corrective  Action  or  Restructuring  Reporting  District 


Interventions 

California 

Georgia 

Pennsylvania 

Intervention 

2005 
(n  =  9) 

2006 
(n  =  8) 

2005 
(n  =  4) 

2006 
(n  =  5) 

2005 
(n  =  0) 

2006 
(n  =  4) 

Extending  the  school  day  or 
school  year 

2 

2 

3 

0 

NA 

0 

Appointing  an  outside  expert 
to  advise  the  school 

0 

4 

2 

2 

NA 

1 

Reassigning  or  demoting  the 
principal 

0 

0 

2 

1 

NA 

0 

Significantly  decreasing 
management  authority  at  the 
school  level 

1 

2 

0 

1 

NA 

1 

Restructuring  the  internal 
organization  of  the  school 

1 

2 

0 

0 

NA 

1 

Replacing  school  staff  who 
are  relevant  to  the  failure  to 
make  AYP 

0 

0 

1 

0 

NA 

1 

Replacing  all  or  most  of  the 
school  staff 

0 

0 

0 

0 

NA 

0 

Reopening  the  school  as  a 
public  charter  school 

0 

0 

0 

0 

NA 

0 

Entering  into  a  contract  with  a 
private  management  company 
to  operate  the  school 

0 

0 

0 

0 

NA 

0 

NOTE:  Response  options  included  yes  and 

no. 

Table  B.38 

Teachers  Reporting  Emphasis  on  PD  Activities 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Activity 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Aligning  curriculum 

65 

61 

68 

52 

63 

60 

67 

64 

79 

68 

83 

75 

63 

61 

70 

64 

60 

59 

and  instruction  with 
state  and/or  district 
content  standards 

(6) 

(4) 

(5) 

(5) 

(4) 

(5) 

(3) 

(3) 

(2) 

(3) 

(2) 

(2) 

(4) 

(4) 

(3) 

(4) 

(3) 

(5) 

Instructional 

56 

48 

57 

44 

53 

47 

61 

55 

68 

57 

64 

54 

43 

38 

46 

39 

42 

35 

strategies  for  low- 
achieving  students 

(3) 

(5) 

(5) 

(5) 

(4) 

(5) 

(4) 

(3) 

(3) 

(2) 

(3) 

(3) 

(3) 

(2) 

(3) 

(5) 

(2) 

(3) 

Preparing  students 

31 

31 

47 

28 

42 

31 

65 

56 

74 

56 

69 

62 

66 

57 

67 

58 

62 

55 

to  take  the  state 
assessments 

(5) 

(4) 

(6) 

(4) 

(5) 

(4) 

(4) 

(3) 

(3) 

(3) 

(3) 

(3) 

(4) 

(4) 

(3) 

(4) 

(4) 

(8) 

Instructional 

53 

42 

57 

40 

54 

41 

17 

19 

27 

17 

23 

16 

11 

11 

14 

10 

11 

11 

strategies  for  ELLs 

(5) 

(5) 

(5) 

(5) 

(5) 

(6) 

(2) 

(3) 

(2) 

(2) 

(2) 

(2) 

(2) 

(3) 

(2) 

(3) 

(D 

(2) 

Math  and  math 

51 

50 

53 

42 

52 

37 

54 

39 

57 

52 

58 

49 

57 

36 

64 

44 

57 

45 

teaching 

(6) 

(5) 

(4) 

(5) 

(5) 

(5) 

(4) 

(3) 

(4) 

(3) 

(4) 

(2) 

(6) 

(4) 

(4) 

(3) 

(4) 

(4) 

Interpreting  and 

32 

33 

44 

24 

43 

26 

47 

40 

65 

45 

60 

49 

38 

27 

36 

33 

36 

32 

using  reports  of 
student  test  results 

(5) 

(4) 

(6) 

(3) 

(7) 

(3) 

(4) 

(3) 

(3) 

(4) 

(4) 

(3) 

(4) 

(3) 

(4) 

(7) 

(4) 

(5) 

Instructional 

33 

26 

25 

25 

21 

32 

34 

40 

39 

42 

40 

44 

28 

33 

33 

33 

30 

28 

strategies  for  special 
education  students 

(4) 

(4) 

(4) 

(4) 

(3) 

(3) 

(2) 

(3) 

(2) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

(4) 

(2) 

(4) 

Science  and  science 

16 

27 

28 

26 

16 

36 

21 

25 

20 

32 

32 

36 

18 

21 

22 

30 

28 

31 

teaching 

(3) 

(4) 

(4) 

(4) 

(4) 

(6) 

(3) 

(2) 

(2) 

(2) 

(3) 

(2) 

(2) 

(2) 

(3) 

(5) 

(4) 

(6) 

NOTES:  Response  options  included  no  emphasis,  minor  emphasis,  moderate  emphasis,  and  major  emphasis.  Percentages  represent  the  sum  of  the 
moderate  and  major  emphasis  responses. 


Results  Tables  113 


114  Pain  and  Gain:  Implementing  No  Child  Left  Behind  in  Three  States,  2004-2006 


Table  B.39 

Superintendents  Reporting  Need  for  Technical  Assistance  and  Receipt  of  Assistance  If 
Needed 


California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania,  %  (SE) 

2005 

2006 

2005 

2006 

2005 

2006 

Assistance 

N 

R 

N 

R 

N 

R 

N 

R 

N 

R 

N 

R 

Identify  effective 
methods  and 
instructional 
strategies  in 
scientifically  based 
research 

79 

(9) 

53 

(16) 

16 

(10) 

64 

(12) 

70 

(14) 

74 

(13) 

71 

(13) 

93 

(7) 

88 

(9) 

38 

(14) 

14 

(7) 

55 

(15) 

Provide  effective  PD 

74 

(10) 

69 

(16) 

69 

(11) 

61 

(13) 

72 

(14) 

92 

(5) 

69 

(13) 

93 

(7) 

77 

(12) 

58 

(15) 

78 

(11) 

53 

(17) 

Use  data  more 
effectively 

48 

(14) 

57 

(18) 

72 

(10) 

73 

(13) 

74 

(13) 

90 

(7) 

80 

(11) 

100 

(0) 

87 

(9) 

55 

(16) 

85 

(7) 

63 

(15) 

Clarify  accountability 
system  rules  and 
requirements 

84 

(8) 

96 

(4) 

41 

(11) 

94 

(6) 

55 

(15) 

86 

(13) 

66 

(13) 

100 

(0) 

57 

(15) 

100 

(0) 

45 

(14) 

59 

(21) 

Develop  and 
implement  a  district 
improvement  plan 

43 

(13) 

93 

(6) 

22 

(10) 

77 

(10) 

45 

(15) 

78 

(16) 

58 

(13) 

79 

(15) 

50 

(15) 

69 

(24) 

18 

(10) 

19 

(15) 

Develop  curriculum 
guides  or  model 
lessons  based 
on  state  content 
standards 

34 

(12) 

31 

(19) 

47 

(12) 

56 

(19) 

50 

(15) 

90 

(7) 

58 

(13) 

100 

(0) 

86 

(6) 

62 

(17) 

65 

(13) 

41 

(17) 

Promote  parent 
involvement 

37 

(12) 

42 

(20) 

57 

(11) 

37 

(16) 

52 

(14) 

60 

(18) 

62 

(13) 

51 

(17) 

70 

(13) 

17 

(14) 

44 

(14) 

41 

(22) 

Help  the  district 
work  with  schools 
in  need  of 
improvement 

37 

(12) 

78 

(16) 

39 

(11) 

55 

(21) 

62 

(14) 

100 

(0) 

60 

(13) 

89 

(10) 

39 

(15) 

30 

(19) 

33 

(12) 

36 

(24) 

NOTES:  Response  options  included  yes  and  no  to  whether  needed,  received,  and  sufficient.  "N"  is 
needed,  and  "R"  is  received,  if  needed. 


Table  B.40 

Educators  Reporting  Changes  in  Their  Schools  or  Districts  as  a  Result  of  the  State's  Accountability  System 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005  2006 

2004  2005  2006 

For  For 

For  For 

For  For 

For  For 

For  For  For  For 

For  For  For  For  For  For 

Respondent  Better  Worse  Better  Worse  Better  Worse  Better  Worse  Better  Worse  Better  Worse  Better  Worse  Better  Worse  Better  Worse 


Academic  rigor  of  the  curriculum 


Super¬ 

65 

4 

61 

2 

62 

0 

50 

3 

76 

0 

57 

1 

62 

7 

61 

9 

57 

12 

intendents 

(12) 

(4) 

(12) 

(2) 

(12) 

(NA) 

(14) 

(3) 

(10) 

(NA) 

(14) 

(D 

(12) 

(6) 

(15) 

(8) 

(13) 

(8) 

Elementary 

39 

19 

61 

10 

81 

0 

57 

0 

62 

0 

72 

3 

55 

12 

68 

3 

70 

2 

school 

principals 

(12) 

(7) 

(10) 

(6) 

(6) 

(0) 

(11) 

(11) 

(11) 

(NA) 

(8) 

(3) 

(11) 

(6) 

(8) 

(2) 

(8) 

(2) 

Middle  school 

50 

4 

79 

2 

52 

2 

54 

0 

40 

4 

77 

0 

49 

3 

38 

2 

45 

1 

principals 

(14) 

(4) 

(7) 

(2) 

(12) 

(2) 

(8) 

(NA) 

(11) 

(4) 

(7) 

(NA) 

(13) 

(2) 

(12) 

Elementary 

34 

16 

42 

16 

48 

17 

40 

13 

47 

12 

48 

10 

28 

33 

26 

26 

32 

28 

school 

teachers 

(5) 

(3) 

(4) 

(3) 

(7) 

(3) 

(3) 

(2) 

(3) 

(D 

(3) 

(2) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

Middle  school 

32 

10 

39 

10 

47 

11 

39 

17 

42 

11 

46 

8 

26 

21 

25 

15 

34 

16 

teachers 

(5) 

(3) 

(4) 

(2) 

(5) 

(3) 

(3) 

(2) 

(3) 

(D 

(3) 

(D 

(3) 

(2) 

(3) 

(2) 

(4) 

(3) 

Principal/teacher  focus 

on  student  learning3 

Super¬ 

45 

0 

68 

0 

80 

0 

84 

0 

88 

2 

87 

12 

intendents 

(14) 

(NA) 

(11) 

(NA) 

(10) 

(NA) 

(8) 

(NA) 

(7) 

(2) 

(8) 

(8) 

Elementary 

57 

15 

81 

0 

86 

0 

0 

3 

77 

2 

79 

0 

61 

11 

73 

4 

75 

6 

school 

principals 

(9) 

(8) 

(9) 

(NA) 

(5) 

(7) 

(3) 

(6) 

(2) 

(8) 

(NA) 

(9) 

(5) 

(8) 

(3) 

(8) 

(4) 

Middle  school 

63 

0 

79 

5 

74 

0 

69 

0 

80 

0 

93 

0 

70 

5 

45 

7 

70 

3 

principals 

(18) 

(NA) 

(10) 

(4) 

(10) 

(NA) 

(8) 

(NA) 

(7) 

(NA) 

(3) 

(NA) 

(10) 

(3) 

(13) 

(4) 

(10) 

(2) 

Elementary 

44 

9 

44 

12 

53 

10 

2 

6 

59 

3 

62 

5 

39 

15 

45 

8 

40 

10 

school 

teachers 

(6) 

(2) 

(5) 

(3) 

(7) 

(2) 

(3) 

(D 

(3) 

(D 

(3) 

(D 

(4) 

(3) 

(3) 

(2) 

(4) 

(2) 

Middle  school 

36 

8 

48 

6 

50 

6 

52 

10 

63 

7 

59 

4 

35 

19 

36 

12 

39 

8 

teachers 

(5) 

(2) 

(5) 

(2) 

(4) 

(2) 

(3) 

(D 

(3) 

(2) 

(3) 

(D 

(4) 

(3) 

(7) 

(2) 

(4) 

(2) 
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Table  B.40 — Continued 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

Respondent 

Better  Worse 

■  Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better 

Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Students'  focus  on  school  workb 

Elementary 

36 

11 

30 

0 

46 

0 

48 

0 

51 

0 

59 

0 

30 

1 

21 

7 

37 

6 

school 

principals 

(12) 

(7) 

(10) 

(NA) 

(9) 

(NA) 

(7) 

(NA) 

(8) 

(NA) 

(8) 

(NA) 

(10) 

(D 

(6) 

(4) 

(7) 

(4) 

Middle  school 

21 

4 

51 

2 

43 

0 

42 

0 

42 

0 

40 

0 

18 

1 

27 

3 

24 

4 

principals 

(12) 

(4) 

(11) 

(2) 

(13) 

(NA) 

(9) 

(NA) 

(10) 

(NA) 

(9) 

(NA) 

(7) 

(D 

(11) 

(2) 

(9) 

(3) 

Elementary 

22 

5 

23 

9 

31 

5 

27 

6 

36 

5 

34 

6 

13 

12 

15 

10 

20 

11 

school 

teachers 

(5) 

(2) 

(4) 

(2) 

(5) 

(2) 

(3) 

(D 

(3) 

(D 

(3) 

(2) 

(2) 

(2) 

(2) 

(2) 

(3) 

(2) 

Middle  school 

13 

9 

20 

10 

21 

9 

18 

13 

21 

16 

28 

10 

10 

14 

10 

10 

13 

14 

teachers 

(3) 

(2) 

(2) 

(2) 

(5) 

(2) 

(2) 

(2) 

(2) 

(3) 

(3) 

(D 

(2) 

(4) 

(3) 

(2) 

(4) 

(3) 

Students'  learning  of 

important  skills  and  knowledge 

b 

Elementary 

43 

11 

60 

1 

66 

0 

59 

0 

72 

0 

75 

0 

45 

8 

57 

7 

56 

10 

school 

principals 

(12) 

(7) 

(9) 

(D 

(7) 

(0) 

(7) 

(NA) 

(7) 

(NA) 

(7) 

(NA) 

(11) 

(6) 

(8) 

(5) 

(9) 

(5) 

Middle  school 

42 

0 

66 

2 

50 

8 

55 

1 

56 

0 

75 

2 

36 

0 

33 

23 

73 

1 

principals 

(17) 

(NA) 

(11) 

(2) 

(12) 

(8) 

(8) 

(D 

(10) 

(NA) 

(8) 

(2) 

(12) 

(NA) 

(12) 

(17) 

(9) 

(D 

Elementary 

31 

6 

35 

8 

46 

8 

41 

6 

49 

4 

47 

5 

23 

12 

30 

8 

32 

11 

school 

teachers 

(5) 

(D 

(4) 

(2) 

(6) 

(2) 

(3) 

(D 

(3) 

(D 

(3) 

(D 

(3) 

(2) 

(3) 

(2) 

(3) 

(2) 

Middle  school 

30 

11 

36 

10 

39 

9 

36 

10 

37 

8 

42 

7 

17 

16 

25 

12 

25 

15 

teachers 

(4) 

(3) 

(3) 

(2) 

(4) 

(2) 

(3) 

(D 

(2) 

(2) 

(2) 

(D 

(4) 

(3) 

(7) 

(5) 

(5) 

(2) 

NOTE:  Response  options  included  changed  for  the  worse,  did  not  change  due  to  accountability  system,  and  changed  for  the  better. 


a  We  asked  superintendents  about  principals'  focus  on  student  learning.  We  asked  principals  about  teachers'  focus. 
b  We  did  not  ask  superintendents  this  question. 
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Table  B.41 

Teachers  and  Principals  Agreeing  That  the  State's  Accountability  System  Has  Been 
Beneficial  for  Students 


Respondent 

California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Elementary  school  principals 

51 

79 

77 

88 

67 

71 

(13) 

(8) 

(6) 

(5) 

(9) 

(8) 

Middle  school  principals 

77 

70 

60 

76 

56 

61 

(7) 

(8) 

(9) 

(8) 

(14) 

(12) 

Elementary  school  teachers 

40 

28 

37 

45 

54 

54 

22 

30 

31 

(5) 

(3) 

(5) 

(2) 

(2) 

(3) 

(4) 

(3) 

(4) 

Middle  school  teachers 

32 

34 

34 

44 

50 

50 

29 

29 

28 

(5) 

(3) 

(5) 

(2) 

(2) 

(2) 

(4) 

(3) 

(3) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.42 

Teachers  Indicating  Various  Changes  in  Their  Schools  as  a  Result  of  the  State's  Accountability  System 


Respondent 

California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

The  principal's  effectiveness  as 

an  instructional  leader 

Elementary 

25 

7 

31 

11 

38 

9 

41 

7 

46 

8 

41 

8 

26 

10 

27 

9 

24 

10 

school 

teachers 

(7) 

(2) 

(5) 

(3) 

(6) 

(2) 

(4) 

(D 

(3) 

(2) 

(3) 

(2) 

(3) 

(2) 

(2) 

(2) 

(3) 

(3) 

Middle  school 

31 

9 

30 

8 

28 

14 

32 

13 

44 

13 

37 

12 

25 

14 

21 

19 

24 

10 

teachers 

(5) 

(3) 

(3) 

(2) 

(4) 

(4) 

(2) 

(2) 

(3) 

(2) 

(3) 

(D 

(2) 

(3) 

(3) 

(7) 

(5) 

(2) 

Teachers'  relationships  with  their  students 

Elementary 

14 

12 

22 

14 

27 

16 

30 

9 

34 

5 

34 

7 

14 

17 

16 

11 

18 

15 

school 

teachers 

(4) 

(2) 

(4) 

(3) 

(5) 

(3) 

(3) 

(2) 

(3) 

(D 

(3) 

(D 

(2) 

(2) 

(2) 

(2) 

(2) 

(2) 

Middle  school 

10 

10 

18 

11 

19 

10 

26 

11 

33 

10 

31 

9 

9 

10 

14 

6 

13 

10 

teachers 

(2) 

(2) 

(3) 

(2) 

(2) 

(2) 

(2) 

(2) 

(3) 

(2) 

(2) 

(2) 

(2) 

(4) 

(2) 

(2) 

(3) 

(2) 

My  own  teaching  practice 

Elementary 

33 

8 

43 

10 

51 

8 

51 

5 

59 

5 

61 

5 

38 

15 

40 

11 

43 

12 

school 

teachers 

(5) 

(2) 

(5) 

(2) 

(6) 

(D 

(4) 

(D 

(4) 

(D 

(4) 

(D 

(4) 

(3) 

(3) 

(2) 

(4) 

(2) 

Middle  school 

37 

8 

45 

6 

48 

6 

52 

7 

56 

4 

56 

3 

37 

11 

32 

4 

44 

6 

teachers 

(5) 

(2) 

(4) 

(2) 

(5) 

(2) 

(3) 

(D 

(3) 

(D 

(3) 

(D 

(3) 

(3) 

(5) 

(D 

(4) 

(2) 

NOTE:  Response  options  included  changed  for  the  worse,  did  not  change  due  to  accountability  system,  and  changed  for  the  better. 


118  Pain  and  Gain:  Implementing  No  Child  Left  Behind  in  Three  States,  2004-2006 


Table  B.43 

Elementary  School  Teachers  Reporting  That  Their  Instruction  Differs  as  a  Result  of  Mathematics  and  Science  Assessments 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE)a 


2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Difference 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Assign  more 

37 

8 

42 

8 

31 

11 

33 

18 

29 

21 

32 

20 

31 

NA 

30 

NA 

30 

NA 

homework 

(4) 

(2) 

(4) 

(2) 

(4) 

(2) 

(4) 

(3) 

(4) 

(3) 

(3) 

(3) 

(4) 

(4) 

(3) 

Spend  more  time 

53 

27 

52 

29 

51 

26 

58 

43 

58 

43 

58 

46 

55 

NA 

53 

NA 

55 

NA 

teaching  content 

(5) 

(4) 

(3) 

(4) 

(5) 

(3) 

(3) 

(4) 

(4) 

(4) 

(3) 

(4) 

(4) 

(4) 

(4) 

Offer  more  assistance 

26 

4 

29 

8 

27 

10 

31 

15 

34 

16 

33 

15 

14 

NA 

21 

NA 

21 

NA 

outside  of  school  for 
students  who  are  not 
proficient 

(5) 

(2) 

(3) 

(2) 

(4) 

(3) 

(4) 

(3) 

(3) 

(3) 

(4) 

(2) 

(2) 

(3) 

(3) 

Search  for  more 

76 

44 

67 

33 

62 

39 

77 

73 

74 

64 

76 

67 

76 

NA 

60 

NA 

60 

NA 

effective  teaching 
methods 

(3) 

(4) 

(3) 

(4) 

(5) 

(4) 

(3) 

(4) 

(4) 

(5) 

(3) 

(3) 

(3) 

(4) 

(3) 

Focus  more  on 

84 

47 

73 

45 

68 

48 

85 

85 

77 

68 

76 

72 

74 

NA 

76 

NA 

78 

NA 

standards 

(3) 

(6) 

(4) 

(4) 

(5) 

(3) 

(2) 

(3) 

(3) 

(4) 

(3) 

(4) 

(3) 

(3) 

(3) 

Focus  more  on 

62 

21 

63 

35 

64 

28 

70 

60 

72 

57 

71 

62 

75 

NA 

72 

NA 

71 

NA 

topics  emphasized  in 
assessment 

(3) 

(5) 

(5) 

(4) 

(4) 

(3) 

(4) 

(4) 

(3) 

(4) 

(4) 

(5) 

(3) 

(3) 

(4) 

Emphasize 

46 

16 

55 

20 

56 

23 

72 

65 

78 

59 

75 

63 

77 

NA 

74 

NA 

81 

NA 

assessment  styles  and 
formats  of  problems 

(4) 

(3) 

(4) 

(4) 

(5) 

(3) 

(3) 

(4) 

(3) 

(4) 

(3) 

(4) 

(3) 

(3) 

(3) 

Spend  more  time 

53 

15 

53 

25 

53 

27 

56 

45 

56 

42 

59 

47 

57 

NA 

51 

NA 

56 

NA 

teaching  test-taking 
strategies 

(5) 

(4) 

(4) 

(4) 

(5) 

(3) 

(3) 

(3) 

(4) 

(4) 

(3) 

(5) 

(3) 

(3) 

(3) 

Focus  more  on 

27 

11 

37 

9 

41 

14 

28 

17 

36 

23 

39 

31 

28 

NA 

29 

NA 

30 

NA 

students  who  are 

(4) 

(3) 

(4) 

(2) 

(4) 

(2) 

(4) 

(3) 

(2) 

(3) 

(3) 

(3) 

(3) 

(2) 

(3) 

close  to  proficient 
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Table  B.43 — Continued 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE)a 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Difference 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Rely  more  heavily 

22 

16 

24 

19 

29 

23 

38 

41 

37 

41 

37 

40 

19 

NA 

18 

NA 

23 

NA 

on  multiple- 
choice  tests 

(3) 

(4) 

(5) 

(4) 

(5) 

(3) 

(4) 

(4) 

(4) 

(4) 

(3) 

(4) 

(3) 

(3) 

(2) 

Rely  more  heavily 

33 

25 

21 

17 

21 

19 

26 

34 

23 

27 

27 

30 

61 

NA 

50 

NA 

46 

NA 

on  open-ended 

(5) 

(3) 

(4) 

(3) 

(3) 

(3) 

(4) 

(5) 

(4) 

(3) 

(2) 

(3) 

(4) 

(2) 

(3) 

tests 


NOTES:  Response  options  included  not  at  all,  a  small  amount,  a  moderate  amount,  and  a  great  deal.  Percentages  represent  the  sum  of  a  moderate 
amount  and  a  great  deal  responses. 

a  We  did  not  present  these  questions  to  Pennsylvania  science  teachers  because  there  was  no  state  science  test. 
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Table  B.44 

Middle  School  Teachers  Reporting  That  Their  Instruction  Differs  as  a  Result  of  Mathematics  and  Science  Assessments 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


2004  2005  2006  2004  2005  2006  2004  2005  2006 


Difference 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Assign  more 

38 

15 

29 

8 

21 

11 

31 

25 

29 

26 

23 

23 

19 

NA 

13 

NA 

28 

NA 

homework 

(7) 

(4) 

(4) 

(3) 

(4) 

(3) 

(3) 

(3) 

(3) 

(3) 

(2) 

(2) 

(3) 

(3) 

(4) 

Spend  more  time 

67 

50 

58 

35 

57 

41 

73 

76 

69 

67 

69 

71 

64 

NA 

59 

NA 

59 

NA 

teaching  content 

(5) 

(5) 

(3) 

(6) 

(5) 

(5) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

(7) 

(6) 

Offer  more 

77 

62 

66 

46 

69 

53 

80 

83 

72 

77 

72 

81 

66 

NA 

69 

NA 

74 

NA 

assistance  outside 
of  school  for 
students  who  are 
not  proficient 

(4) 

(5) 

(4) 

(6) 

(5) 

(7) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

(5) 

(3) 

(4) 

Search  for  more 

75 

28 

57 

27 

56 

41 

71 

62 

73 

64 

72 

63 

56 

NA 

71 

NA 

75 

NA 

effective  teaching 
methods 

(4) 

(7) 

(5) 

(7) 

(5) 

(7) 

(3) 

(4) 

(3) 

(4) 

(2) 

(3) 

(5) 

(7) 

(5) 

Focus  more  on 

49 

18 

44 

23 

52 

23 

67 

66 

71 

65 

69 

65 

57 

NA 

62 

NA 

72 

NA 

standards 

(6) 

(5) 

(5) 

(4) 

(6) 

(6) 

(4) 

(3) 

(3) 

(3) 

(3) 

(4) 

(6) 

(4) 

(5) 

Focus  more  on 

50 

27 

45 

26 

45 

24 

44 

44 

44 

48 

48 

44 

39 

NA 

38 

NA 

41 

NA 

topics  emphasized 
in  assessment 

(6) 

(8) 

(7) 

(6) 

(6) 

(7) 

(4) 

(3) 

(3) 

(3) 

(3) 

(3) 

(6) 

(4) 

(4) 

Emphasize 

64 

44 

45 

24 

40 

25 

64 

63 

53 

59 

53 

49 

44 

NA 

46 

NA 

49 

NA 

assessment  styles 
and  formats  of 

(5) 

(5) 

(6) 

(4) 

(4) 

(3) 

(3) 

(3) 

(3) 

(4) 

(2) 

(4) 

(4) 

(3) 

(5) 

problems 

Spend  more  time 

33 

16 

19 

8 

22 

12 

26 

24 

37 

30 

39 

30 

16 

NA 

22 

NA 

31 

NA 

teaching  test¬ 
taking  strategies 

(7) 

(6) 

(3) 

(2) 

(3) 

(3) 

(3) 

(3) 

(4) 

(3) 

(4) 

(4) 

(3) 

(5) 

(3) 

Focus  more  on 

38 

15 

26 

9 

30 

8 

44 

29 

41 

33 

44 

27 

26 

NA 

19 

NA 

22 

NA 

students  who  are 
close  to  proficient 

(7) 

(5) 

(3) 

(2) 

(4) 

(2) 

(4) 

(4) 

(3) 

(3) 

(4) 

(2) 

(5) 

(5) 

(4) 
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Table  B.44 — Continued 


Difference 

California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Math 

Sci 

Rely  more  heavily  on 

25 

15 

23 

20 

19 

24 

35 

59 

38 

54 

35 

47 

19 

NA 

9 

NA 

17 

NA 

multiple-choice  tests 

(6) 

(5) 

(3) 

(3) 

(6) 

(4) 

(5) 

(4) 

(4) 

(3) 

(5) 

(3) 

(4) 

(2) 

(4) 

Rely  more  heavily  on 

29 

30 

12 

11 

17 

11 

30 

33 

23 

26 

20 

27 

39 

NA 

33 

NA 

46 

NA 

open-ended  tests 

(3) 

(6) 

(2) 

(2) 

(5) 

(3) 

(3) 

(3) 

(2) 

(3) 

(3) 

(3) 

(4) 

(5) 

(6) 

NOTES:  Response  options  included  not  at  all,  a  small  amount,  a  moderate  amount,  and  a  great  deal.  Percentages  represent  the  sum  of  a  moderate 
amount  and  a  great  deal  responses. 

a  We  did  not  present  these  questions  to  Pennsylvania  science  teachers  because  there  was  no  state  science  test. 
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Table  B.45 

Administrators  Reporting  Various  Changes  as  a  Result  of  the  State's  Accountability  System 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


2004  2005  2006  2004  2005  2006  2004  2005  2006 


For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

For 

Respondent 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Better  Worse 

Coordination  of  mathematics  curriculum  across  grades 

Super- 

41 

4 

73 

0 

63 

0 

29 

3 

49 

2 

63 

0 

72 

6 

76 

2 

99 

0 

intendents 

(14) 

(4) 

(10) 

(NA) 

(11) 

(NA) 

(13) 

(3) 

(14) 

(2) 

(14) 

(NA) 

(11) 

(6) 

(14) 

(2) 

(D 

(NA) 

Elementary 

48 

0 

50 

0 

37 

0 

37 

0 

51 

0 

52 

0 

67 

0 

76 

1 

63 

0 

school 

principals 

(11) 

(NA) 

(12) 

(NA) 

(8) 

(0) 

(8) 

(NA) 

(8) 

(NA) 

(9) 

(NA) 

(11) 

(NA) 

(8) 

(D 

(9) 

(NA) 

Middle  school 

47 

0 

67 

0 

78 

0 

55 

0 

46 

0 

64 

4 

76 

0 

82 

0 

71 

2 

principals 

(10) 

(NA) 

(10) 

(NA) 

(9) 

(NA) 

(9) 

(NA) 

(9) 

(NA) 

(9) 

(4) 

(9) 

(NA) 

(8) 

(NA) 

(8) 

(2) 

Coordination  of  science  curriculum  across  grade  levels 

Super- 

20 

23 

54 

1 

13 

0 

8 

3 

43 

4 

58 

0 

35 

2 

42 

2 

58 

0 

intendents 

(10) 

(13) 

(12) 

(D 

(7) 

(NA) 

(5) 

(3) 

(14) 

(3) 

(14) 

(NA) 

(12) 

(3) 

(15) 

(2) 

(13) 

(NA) 

Elementary 

28 

0 

27 

0 

21 

0 

29 

0 

33 

0 

37 

0 

40 

4 

30 

9 

36 

8 

school 

principals 

(12) 

(NA) 

(10) 

(NA) 

(5) 

(NA) 

(9) 

(NA) 

(9) 

(NA) 

(9) 

(NA) 

(10) 

(3) 

(10) 

(7) 

(10) 

(6) 

Middle  school 

22 

0 

45 

0 

43 

0 

30 

0 

20 

0 

69 

2 

52 

2 

45 

0 

47 

0 

principals 

(10) 

(NA) 

(10) 

(NA) 

(13) 

(NA) 

(7) 

(NA) 

(5) 

(NA) 

(8) 

(2) 

(12) 

(D 

(14) 

(NA) 

(11) 

(NA) 

Extent  to  which  innovative  curricular  programs  or  instructional  approaches  are  used 

Elementary 

32 

19 

43 

21 

64 

0 

65 

0 

42 

9 

47 

8 

school 

principals 

(10) 

(9) 

(12) 

(7) 

(6) 

(NA) 

(7) 

(NA) 

(9) 

(5) 

(8) 

(6) 

Middle  school 

26 

20 

38 

22 

37 

2 

45 

6 

38 

4 

45 

3 

principals 

(7) 

(10) 

(13) 

(11) 

(9) 

(2) 

(10) 

(6) 

(12) 

(3) 

(11) 

(2) 

NOTE:  Response  options  included  changed  for  the  worse,  did  not  change  due  to  accountability  system,  and  changed  for  the  better. 
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Table  B.46 


Educators  Reporting  Changes  in  Staff  Morale  as  a  Result  of  the  State's  Accountability 
System 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

Respondent 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Change  for  the  better 

District  superintendents 

0 

0 

0 

6 

12 

35 

0 

10 

16 

(NA) 

(NA) 

(NA) 

(4) 

(11) 

(14) 

(NA) 

(9) 

(11) 

Elementary  school  principals 

3 

5 

15 

20 

20 

23 

7 

8 

9 

(2) 

(4) 

(10) 

(6) 

(5) 

(8) 

(5) 

(5) 

(4) 

Middle  school  principals 

16 

22 

4 

28 

19 

23 

18 

13 

13 

(12) 

(8) 

(3) 

(8) 

(7) 

(10) 

(9) 

(8) 

(8) 

Elementary  school  teachers 

7 

10 

17 

15 

20 

17 

6 

6 

9 

(3) 

(3) 

(3) 

(2) 

(2) 

(2) 

(D 

(D 

(2) 

Middle  school  teachers 

8 

10 

11 

13 

15 

20 

5 

4 

4 

(3) 

(2) 

(3) 

(2) 

(2) 

(3) 

(2) 

(D 

(D 

Change  for  the  worse 

District  superintendents 

69 

77 

77 

51 

76 

38 

72 

77 

55 

(12) 

(11) 

(10) 

(14) 

(13) 

(12) 

(11) 

(12) 

(13) 

Elementary  school  principals 

63 

65 

43 

38 

27 

36 

53 

53 

44 

(8) 

(11) 

(8) 

(9) 

(5) 

(9) 

(10) 

(10) 

(7) 

Middle  school  principals 

37 

34 

19 

35 

41 

33 

67 

53 

35 

(8) 

(10) 

(9) 

(8) 

(8) 

(10) 

(12) 

(13) 

(10) 

Elementary  school  teachers 

56 

48 

46 

47 

39 

39 

73 

63 

60 

(4) 

(4) 

(4) 

(2) 

(4) 

(3) 

(4) 

(4) 

(5) 

Middle  school  teachers 

59 

49 

48 

56 

50 

45 

72 

66 

63 

(4) 

(4) 

(4) 

(3) 

(3) 

(3) 

(3) 

(3) 

(4) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree. 
Percentages  represent  the  sum  of  the  agree  and  strongly  agree  responses. 


Table  B.47 

Teachers  in  Tested  Grades  Reporting  Aligning  Their  Instruction  with  State  Assessments  and  State  Content  Standards 


Measure 

California,  %  (SE) 

Georgia 

,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Math  teachers 

Standards 

97 

96 

95 

93 

94 

95 

95 

94 

90 

90 

86 

88 

89 

87 

82 

71 

84 

80 

(D 

(2) 

(D 

(D 

(D 

(2) 

(D 

(D 

(D 

(2) 

(2) 

(2) 

(2) 

(5) 

(3) 

(4) 

(3) 

(4) 

Assessments 

62 

65 

52 

51 

58 

53 

81 

80 

82 

77 

78 

80 

88 

85 

87 

86 

85 

85 

(5) 

(4) 

(4) 

(4) 

(4) 

(6) 

(3) 

(3) 

(3) 

(2) 

(3) 

(3) 

(2) 

(4) 

(3) 

(3) 

(3) 

(4) 

Science  teachers 

Standards 

84 

78 

87 

95 

84 

100 

95 

95 

87 

90 

84 

91 

NAa 

NA 

NA 

NA 

NA 

NA 

(7) 

(16) 

(4) 

(4) 

(5) 

(0) 

(D 

(D 

(2) 

(3) 

(2) 

(2) 

Assessments 

42 

60 

60 

64 

46 

71 

82 

79 

80 

81 

77 

78 

NA 

NA 

NA 

NA 

NA 

NA 

(6) 

(9) 

(7) 

(9) 

(6) 

(11) 

(2) 

(2) 

(3) 

(3) 

(4) 

(3) 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree.  Percentages  represent  the  sum  of  the  agree  and  strongly 
agree  responses. 

a  Excludes  Pennsylvania  science  teachers  because  Pennsylvania  did  not  administer  a  science  test. 


Table  B.48 

Elementary  School  Teachers  Reporting  Changes  in  Instructional  Time  from  Year  to  Year 


California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania, 

%  (SE) 

2002 

-2003  to 

2003 

-2004  to 

2004 

-2005  to 

2002 

-2003  to 

2003 

-2004  to 

2004 

-2005  to 

2002 

-2003  to 

2003 

-2004  to 

2004 

-2005  to 

Subject 

2003-2004 

2004-2005 

2005-2006 

2003-2004 

2004-2005 

2005-2006 

2003-2004 

2004-2005 

2005-2006 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

Changed 

Math 

3 

65 

30 

5 

62 

28 

4 

71 

19 

8 

64 

23 

6 

60 

22 

6 

68 

18 

4 

60 

35 

3 

55 

38 

4 

65 

26 

(D 

(4) 

(5) 

(2) 

(3) 

(3) 

(D 

(4) 

(3) 

(2) 

(4) 

(3) 

(D 

(3) 

(2) 

(D 

(3) 

(2) 

(D 

(5) 

(5) 

(D 

(5) 

(5) 

(D 

(4) 

(3) 

Science 

16 

62 

19 

19 

53 

21 

19 

60 

15 

15 

67 

11 

10 

63 

11 

12 

67 

9 

24 

63 

7 

22 

62 

8 

18 

61 

11 

(4) 

(4) 

(3) 

(3) 

(4) 

(3) 

(3) 

(6) 

(3) 

(2) 

(3) 

(2) 

(D 

(3) 

(2) 

(2) 

(2) 

(2) 

(4) 

(4) 

(2) 

(4) 

(4) 

(2) 

(3) 

(3) 

(3) 

Reading/ 

2 

64 

31 

3 

59 

32 

3 

59 

31 

7 

62 

25 

4 

62 

21 

4 

63 

21 

2 

61 

33 

7 

63 

24 

3 

66 

23 

ELA 

(D 

(4) 

(4) 

(D 

(4) 

(4) 

(D 

(6) 

(6) 

(2) 

(3) 

(3) 

(D 

(3) 

(2) 

(D 

(3) 

(3) 

0) 

(3) 

(3) 

(3) 

(4) 

(3) 

0) 

(3) 

(3) 

Social 

20 

67 

4 

28 

55 

10 

23 

62 

9 

14 

64 

13 

11 

65 

9 

11 

67 

9 

26 

63 

6 

25 

60 

6 

22 

61 

6 

Studies 

(4) 

(4) 

(4) 

(5) 

(4) 

(2) 

(4) 

(5) 

(2) 

(2) 

(3) 

(2) 

(D 

(3) 

(2) 

(2) 

(2) 

(2) 

(4) 

(4) 

(2) 

(4) 

(4) 

(D 

(3) 

(3) 

(D 

Arts/ 

26 

58 

11 

23 

60 

9 

23 

61 

9 

18 

68 

5 

9 

69 

4 

6 

70 

8 

3 

91 

1 

2 

88 

3 

1 

89 

1 

Music 

(5) 

(7) 

(4) 

(4) 

(4) 

(2) 

(4) 

(5) 

(2) 

(3) 

(4) 

(D 

(2) 

(3) 

(D 

(2) 

(3) 

(2) 

(D 

(2) 

(0) 

(D 

(2) 

(D 

(D 

(D 

(0) 

PE 

16 

70 

8 

23 

58 

11 

15 

70 

9 

9 

78 

5 

5 

74 

5 

6 

77 

4 

3 

91 

1 

3 

88 

3 

2 

86 

3 

(4) 

(5) 

(3) 

(4) 

(5) 

(3) 

(3) 

(5) 

(2) 

(2) 

(3) 

(2) 

(D 

(2) 

(D 

(2) 

(2) 

(D 

(D 

(2) 

(0) 

(D 

(2) 

(D 

(2) 

(2) 

(D 

NOTES:  Response  options  included  decreased  by  >45  minutes  per  week,  decreased  by  1-45  minutes  per  week,  stayed  the  same,  increased  by  1-45  minutes 
per  week,  increased  by  >45  minutes  per  week,  and  don't  know.  Percentages  for  -  columns  represent  the  sums  of  decreased  by  >45  minutes  per  week  and 
decreased  by  1-45  minutes  per  week  responses.  Percentages  for  +  columns  represent  the  sums  of  increased  by  >45  minutes  per  week  and  increased  by  1-45 
minutes  per  week  responses.  Percentages  for  =  columns  represent  stayed  the  same  responses.  The  omitted  category  is  "don't  know."  PE  =  physical  education. 
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Table  B.49 

Middle  School  Teachers  Reporting  Changes  in  Instructional  Time  from  Year  to  Year 


California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania, 

%  (SE) 

2002 

-2003  to 

2003 

-2004  to 

2004 

-2005  to 

2002 

-2003  to 

2003 

-2004  to 

2004 

-2005  to 

2002 

-2003  to 

2003 

-2004  to 

2004 

-2005  to 

Subject 

2003-2004 

2004-2005 

2005-2006 

2003-2004 

2004-2005 

2005-2006 

2003-2004 

2004-2005 

2005-2006 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

- 

= 

+ 

Changed 

Math 

3 

67 

17 

1 

67 

20 

2 

73 

11 

4 

64 

19 

5 

53 

29 

4 

62 

19 

3 

70 

19 

2 

78 

14 

2 

69 

18 

(D 

(5) 

(4) 

(0) 

(3) 

(3) 

(D 

(3) 

(3) 

(D 

(3) 

(3) 

(2) 

(5) 

(6) 

(D 

(4) 

(4) 

(2) 

(5) 

(4) 

(D 

(5) 

(4) 

(D 

(3) 

(4) 

Science 

6 

60 

8 

9 

63 

10 

9 

66 

6 

6 

65 

14 

5 

51 

23 

7 

62 

14 

7 

73 

11 

7 

77 

6 

4 

70 

12 

(2) 

(5) 

(2) 

(3) 

(4) 

(3) 

(5) 

(4) 

(3) 

(D 

(3) 

(2) 

(D 

(4) 

(5) 

(2) 

(4) 

(3) 

(2) 

(5) 

(4) 

(2) 

(6) 

(3) 

(2) 

(5) 

(6) 

Reading/ 

2 

60 

11 

3 

60 

14 

2 

59 

13 

3 

61 

19 

8 

48 

23 

5 

54 

19 

1 

64 

21 

3 

74 

9 

3 

62 

13 

ELA 

(D 

(5) 

(3) 

(D 

(4) 

(3) 

(D 

(3) 

(5) 

(D 

(3) 

(3) 

(2) 

(4) 

(5) 

(2) 

(4) 

(3) 

(0) 

(5) 

(6) 

(D 

(6) 

(3) 

(D 

(5) 

(3) 

Social 

6 

58 

5 

13 

59 

5 

10 

60 

2 

4 

61 

12 

5 

51 

20 

6 

59 

12 

3 

71 

10 

9 

75 

3 

7 

65 

6 

Studies 

(3) 

(4) 

(2) 

(5) 

(4) 

(D 

(5) 

(3) 

(D 

(D 

(3) 

(2) 

(D 

(4) 

(5) 

(D 

(4) 

(3) 

(D 

(3) 

(4) 

(3) 

(6) 

(D 

(3) 

(5) 

(2) 

Arts/ 

12 

46 

3 

14 

48 

8 

6 

56 

1 

6 

57 

4 

9 

52 

5 

6 

55 

7 

5 

67 

3 

5 

74 

6 

4 

69 

3 

Music 

(3) 

(4) 

(D 

(3) 

(4) 

(4) 

(3) 

(3) 

(D 

(D 

(3) 

(D 

(2) 

(3) 

(2) 

(2) 

(4) 

(2) 

(2) 

(3) 

(2) 

(2) 

(4) 

(2) 

(D 

(6) 

(2) 

PE 

5 

62 

5 

5 

68 

3 

2 

67 

6 

6 

59 

4 

8 

55 

5 

7 

59 

4 

4 

69 

3 

3 

75 

5 

6 

68 

1 

(2) 

(4) 

(3) 

(2) 

(4) 

(D 

(D 

(4) 

(3) 

(D 

(3) 

(D 

(2) 

(4) 

(2) 

(2) 

(4) 

(D 

(2) 

(3) 

(2) 

(D 

(4) 

(2) 

(2) 

(6) 

0) 

NOTES:  Response  options  included  decreased  by  >45  minutes  per  week,  decreased  by  1-45  minutes  per  week,  stayed  the  same,  increased  by  1-45  minutes 
per  week,  increased  by  >45  minutes  per  week,  and  don't  know.  Percentages  for  -  columns  represent  the  sums  of  decreased  by  >45  minutes  per  week  and 
decreased  by  1-45  minutes  per  week  responses.  Percentages  for  +  columns  represent  the  sums  of  increased  by  >45  minutes  per  week  and  increased  by  1-45 
minutes  per  week  responses.  Percentages  for  =  columns  represent  stayed  the  same  responses.  The  omitted  category  is  "don't  know." 
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Table  B.50 

Elementary  School  Mathematics  Teachers  Reporting  That  They  Use  Certain 
Instructional  Techniques 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania 

,  %  (SE) 

Technique 

2005 

2006 

2005 

2006 

2005 

2006 

Assign  math  homework 

97 

99 

96 

97 

98 

98 

(D 

(D 

(D 

(D 

(D 

(D 

Have  students  work  on 

45 

45 

46 

52 

43 

52 

extended  math  investigations 
or  projects 

(4) 

(4) 

(3) 

(3) 

(3) 

(3) 

Introduce  content  through 

98 

97 

98 

97 

98 

96 

formal  presentations  or  direct 
instruction 

(D 

(D 

(D 

(D 

(D 

0) 

Provide  help  to  individual 

68 

71 

70 

67 

72 

71 

students  outside  of  class  time 

(3) 

(3) 

(3) 

(3) 

(4) 

(4) 

Confer  with  another  teacher 

81 

86 

90 

92 

89 

88 

about  alternative  ways  to 
present  specific  topics  or 
lessons 

(3) 

(3) 

(D 

(D 

(2) 

(2) 

Have  students  help  other 

91 

89 

93 

93 

92 

90 

students  learn  math  content 

(2) 

(2) 

(D 

(D 

(D 

(D 

Refer  students  for  extra  help 

57 

49 

65 

63 

54 

52 

outside  the  classroom 

(4) 

(3) 

(4) 

(4) 

(4) 

(4) 

Plan  different  assignments 

82 

80 

90 

87 

81 

79 

based  on  performance 

(2) 

(3) 

(D 

(2) 

(2) 

(3) 

Reteach  topics  because 

93 

97 

96 

98 

89 

95 

performance  on  assignments 
or  assessments  did  not  meet 

(2) 

(D 

(D 

(D 

(2) 

(D 

expectations 

Review  assessment  results  to 

91 

94 

95 

96 

89 

93 

identify  individual  students 
who  need  supplemental 
instruction 

(2) 

(2) 

(D 

(D 

(D 

(D 

Review  assessment  results  to 

90 

93 

94 

96 

87 

91 

identify  topics  requiring  more 
or  less  emphasis  in  instruction 

(2) 

(2) 

(D 

(D 

(D 

(D 

Conduct  a  preassessment  to 

65 

67 

67 

76 

60 

58 

find  out  what  students  know 
about  a  topic 

(4) 

(3) 

(3) 

(3) 

(5) 

(3) 

NOTES:  Response  options  were  never,  rarely  (a  few  times  a  year),  sometimes  (once  or  twice  a 
month),  and  often  (once  a  week  or  more).  Percentages  represent  the  sum  of  the  sometimes 
and  often  responses. 
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Table  B.51 

Middle  School  Mathematics  Teachers  Reporting  That  They  Use  Certain  Instructional 
Techniques 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

Technique 

2005 

2006 

2005 

2006 

2005 

2006 

Assign  math  homework 

94 

98 

92 

90 

94 

95 

(2) 

(D 

(2) 

(2) 

(2) 

(2) 

Have  students  work  on 

28 

34 

39 

42 

26 

39 

extended  math  investigations 
or  projects 

(4) 

(4) 

(3) 

(3) 

(3) 

(6) 

Introduce  content  through 

95 

98 

97 

98 

99 

98 

formal  presentations  or  direct 
instruction 

(2) 

(D 

(D 

(D 

(0) 

(D 

Provide  help  to  individual 

85 

87 

85 

86 

80 

76 

students  outside  of  class  time 

(4) 

(3) 

(2) 

(2) 

(11) 

(6) 

Confer  with  another  teacher 

81 

79 

84 

91 

72 

81 

about  alternative  ways  to 
present  specific  topics  or 
lessons 

(3) 

(5) 

(2) 

(2) 

(10) 

(3) 

Have  students  help  other 

86 

87 

94 

95 

84 

86 

students  learn  math  content 

(2) 

(2) 

(D 

(D 

(4) 

(3) 

Refer  students  for  extra  help 

70 

73 

63 

68 

66 

64 

outside  the  classroom 

(3) 

(6) 

(4) 

(3) 

(4) 

(4) 

Plan  different  assignments 

68 

67 

81 

83 

69 

73 

based  on  performance 

(2) 

(5) 

(2) 

(2) 

(5) 

(5) 

Reteach  topics  because 

95 

97 

93 

95 

87 

90 

performance  on  assignments 
or  assessments  did  not  meet 

(2) 

(D 

(D 

(D 

(3) 

(3) 

expectations 

Review  assessment  results  to 

84 

91 

89 

91 

75 

80 

identify  individual  students 
who  need  supplemental 
instruction 

(3) 

(3) 

(2) 

(D 

(6) 

(5) 

Review  assessment  results  to 

86 

86 

90 

95 

83 

81 

identify  topics  requiring  more 
or  less  emphasis  in  instruction 

(2) 

(2) 

(2) 

(D 

(4) 

(5) 

Conduct  a  preassessment  to 

49 

51 

65 

68 

41 

56 

find  out  what  students  know 
about  a  topic 

(4) 

(5) 

(3) 

(3) 

(9) 

(10) 

NOTES:  Response  options  were  never,  rarely  (a  few  times  a  year),  sometimes  (once  or  twice  a 
month),  and  often  (once  a  week  or  more).  Percentages  represent  the  sum  of  the  sometimes 
and  often  responses. 
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Table  B.52 

Elementary  School  Science  Teachers  Reporting  That  They  Use  Certain  Instructional 
Techniques 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


Technique 

2005 

2006 

2005 

2006 

2005 

2006 

Assign  science  homework 

51 

44 

75 

73 

57 

56 

(4) 

(6) 

(3) 

(3) 

(4) 

(4) 

Have  students  do  hands-on 

72 

71 

81 

85 

84 

87 

laboratory  science  activities  or 
investigations 

(3) 

(5) 

(2) 

(3) 

(3) 

(2) 

Introduce  content  through 

93 

92 

99 

99 

97 

95 

formal  presentations  or  direct 
instruction 

(2) 

(2) 

(0) 

(D 

(D 

(D 

Provide  help  to  individual 

25 

26 

41 

37 

30 

30 

students  outside  of  class  time 

(3) 

(4) 

(3) 

(3) 

(3) 

(3) 

Confer  with  another  teacher 

62 

64 

83 

84 

68 

66 

about  alternative  ways  to 
present  specific  topics  or 
lessons 

(5) 

(5) 

(2) 

(2) 

(4) 

(4) 

Have  students  help  other 

66 

64 

87 

84 

75 

73 

students  learn  science  content 

(3) 

(4) 

(2) 

(2) 

(3) 

(3) 

Refer  students  for  extra  help 

20 

18 

35 

28 

16 

13 

outside  the  classroom 

(3) 

(3) 

(3) 

(3) 

(3) 

(2) 

Plan  different  assignments  or 

38 

36 

64 

59 

37 

40 

lessons  based  on  performance 

(3) 

(4) 

(4) 

(3) 

(3) 

(3) 

Reteach  topics  because 

57 

58 

81 

80 

54 

58 

performance  on  assignments 
or  assessments  did  not  meet 

(4) 

(5) 

(3) 

(3) 

(4) 

(3) 

expectations 

Review  assessment  results  to 

61 

62 

81 

83 

62 

68 

identify  individual  students 
who  need  supplemental 
instruction 

(4) 

(5) 

(2) 

(2) 

(3) 

(3) 

Review  assessment  results  to 

61 

63 

82 

82 

60 

66 

identify  topics  requiring  more 
or  less  emphasis  in  instruction 

(4) 

(5) 

(2) 

(2) 

(3) 

(3) 

Conduct  a  preassessment  to 

42 

39 

53 

55 

43 

44 

find  out  what  students  know 

(4) 

(5) 

(3) 

(3) 

(4) 

(4) 

about  a  topic 

NOTES:  Response  options  were  never,  rarely  (a  few  times  a  year),  sometimes  (once  or  twice  a 
month),  and  often  (once  a  week  or  more).  Percentages  represent  the  sum  of  the  sometimes 
and  often  responses 
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Table  B.53 

Middle  School  Science  Teachers  Reporting  That  They  Use  Certain  Instructional 
Techniques 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 


Technique 

2005 

2006 

2005 

2006 

2005 

2006 

Assign  science  homework 

75 

69 

87 

83 

78 

78 

(7) 

(8) 

(3) 

(3) 

(6) 

(5) 

Have  students  do  hands-on 

82 

78 

85 

84 

76 

87 

laboratory  science  activities  or 
investigations 

(5) 

(9) 

(2) 

(3) 

(6) 

(4) 

Introduce  content  through 

98 

93 

98 

97 

94 

97 

formal  presentations  or  direct 
instruction 

(D 

(4) 

(D 

(D 

(4) 

(D 

Provide  help  to  individual 

65 

64 

76 

72 

56 

68 

students  outside  of  class  time 

(7) 

(9) 

(3) 

(3) 

(10) 

(8) 

Confer  with  another  teacher 

69 

67 

84 

89 

69 

78 

about  alternative  ways  to 
present  specific  topics  or 
lessons 

(5) 

(9) 

(2) 

(2) 

(6) 

(5) 

Have  students  help  other 

80 

68 

90 

90 

74 

79 

students  learn  science  content 

(4) 

(5) 

(2) 

(2) 

(6) 

(4) 

Refer  students  for  extra  help 

43 

25 

57 

53 

39 

38 

outside  the  classroom 

(5) 

(5) 

(3) 

(3) 

(7) 

(6) 

Plan  different  assignments  or 

46 

40 

74 

76 

65 

66 

lessons  based  on  performance 

(7) 

(5) 

(3) 

(3) 

(5) 

(4) 

Reteach  topics  because 

59 

63 

80 

82 

62 

71 

performance  on  assignments 
or  assessments  did  not  meet 

(5) 

(7) 

(2) 

(3) 

(3) 

(4) 

expectations 

Review  assessment  results  to 

66 

60 

80 

87 

79 

79 

identify  individual  students 
who  need  supplemental 
instruction 

(7) 

(7) 

(3) 

(2) 

(6) 

(4) 

Review  assessment  results  to 

70 

55 

85 

88 

76 

78 

identify  topics  requiring  more 
or  less  emphasis  in  instruction 

(5) 

(9) 

(2) 

(2) 

(3) 

(3) 

Conduct  a  preassessment  to 

53 

37 

63 

69 

65 

53 

find  out  what  students  know 

(5) 

(5) 

(3) 

(4) 

(3) 

(6) 

about  a  topic 

NOTES:  Response  options  were  never,  rarely  (a  few  times  a  year),  sometimes  (once  or  twice  a 
month),  and  often  (once  a  week  or  more).  Percentages  represent  the  sum  of  the  sometimes 
and  often  responses. 


Table  B.54 

Teachers  Agreeing  with  Statements  About  the  State's  Accountability  System 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Statement 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

The  state's 

82 

86 

89 

90 

89 

88 

82 

84 

87 

85 

82 

83 

87 

87 

88 

87 

87 

95 

accountability  system 
leaves  little  time  to 
teach  content  not  on 
the  state  tests 

(4) 

(2) 

(2) 

(2) 

(2) 

(3) 

(2) 

(2) 

(D 

(2) 

(2) 

(2) 

(3) 

(2) 

(2) 

(2) 

(2) 

(2) 

As  a  result  of  the 

52 

47 

52 

54 

49 

55 

46 

51 

39 

52 

46 

56 

state's  accountability 

(3) 

(3) 

(4) 

(3) 

(2) 

(2) 

(3) 

(2) 

(4) 

(6) 

(3) 

(5) 

system,  high- 
achieving  students 
are  not  receiving 
appropriately 
challenging 
curriculum  or 
instruction3 

NOTES:  Response  options  included  strongly  disagree,  disagree,  agree,  and  strongly  agree.  Percentages  represent  the  sum  of  the  agree  and  strongly 
agree  responses. 

a  Blank  cells  indicate  that  we  did  not  ask  this  question  in  2004. 
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Table  B.55 

Administrators  Reporting  Inadequate  Fiscal  or  Physical  Capital  as  a  Hindrance  to  Their  Improvement  Efforts 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Hindrance 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

Lack  of 

67 

71 

84 

81 

80 

98 

55 

74 

81 

73 

77 

81 

43 

67 

99 

44 

60 

93 

64 

75 

80 

66 

72 

98 

55 

74 

86 

adequate 

funding 

(11) 

(10) 

(2) 

(7) 

(8) 

(9) 

(10) 

(10) 

(9) 

(7) 

(6) 

(D 

(7) 

(8) 

(11) 

(7) 

(9) 

(5) 

(8) 

(10) 

(D 

(9) 

(10) 

(10) 

Inadequate 

9 

30 

27 

3 

8 

10 

11 

23 

8 

23 

29 

30 

23 

18 

19 

11 

12 

4 

23 

30 

31 

16 

30 

26 

14 

38 

17 

school 

facilities 

(6) 

(14) 

(6) 

(2) 

(5) 

(14) 

(6) 

(8) 

(6) 

(8) 

(8) 

(12) 

(7) 

(7) 

(13) 

(4) 

(5) 

(3) 

(7) 

(11) 

(12) 

(6) 

(11) 

(11) 

Shortage  of 

34 

14 

16 

31 

46 

40 

30 

34 

32 

standards- 

based 

curriculum 

materials 

(9) 

(14) 

(9) 

(14) 

(12) 

(13) 

(13) 

Unanticipated 

29 

21 

33 

14 

18 

15 

24 

13 

23 

20 

18 

38 

problems 

(9) 

(7) 

(8) 

(5) 

(5) 

(5) 

(7) 

(5) 

(7) 

(9) 

with  space, 
facilities, 
and  trans¬ 
portation 

NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a  great  hindrance.  Percentages  represent  the  sum  of  the 
moderate  and  great  hindrance  responses.  "E"  is  elementary  principal,  "M"  is  middle  school  principal,  and  "S"  is  superintendent. 
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Table  B.56 

Teachers  Reporting  Inadequate  Resources  as  a  Hindrance  to  Students'  Academic  Success 


California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Hindrance 

Elem 

Mid 

Elem 

Mid  1 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Large  class  size 

51 

66 

59 

69 

55 

60 

44 

54 

39 

57 

40 

55 

55 

60 

47 

57 

47 

50 

(4) 

(4) 

(4) 

(4) 

(7) 

(4) 

(3) 

(4) 

(3) 

(3) 

(3) 

(4) 

(3) 

(4) 

(4) 

(4) 

(3) 

(5) 

Inadequate 

26 

38 

33 

34 

27 

26 

25 

31 

28 

35 

26 

36 

26 

23 

33 

33 

32 

27 

instructional 
resources  (e.g., 
textbooks, 
equipment) 

(6) 

(4) 

(3) 

(3) 

(4) 

(4) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

(4) 

(4) 

(4) 

(6) 

(3) 

(3) 

Lack  of  school 

41 

48 

42 

37 

41 

30 

20 

37 

23 

34 

22 

31 

33 

32 

32 

31 

34 

33 

resources  to  provide 
the  extra  help  for 
students  who  need  it 

(7) 

(5) 

(5) 

(4) 

(4) 

(5) 

(3) 

(3) 

(3) 

(3) 

(3) 

(3) 

(4) 

(4) 

(4) 

(6) 

(4) 

(3) 

NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a  great  hindrance.  Percentages  represent  the  sum 
of  the  moderate  and  great  hindrance  responses. 
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Table  B.57 

Administrators  Reporting  Inadequate  Human  Capital  as  a  Hindrance  to  Their  Improvement  Efforts 


California,  %  (SE) 


Georgia,  %  (SE) 


Pennsylvania,  %  (SE) 


2004  2005  2006  2004  2005  2006  2004  2005  2006 


Hindrance  EMS  EMS  EMS  EMS  EMS  EMS  EMS  EMS  EMS 


Shortage 
of  qualified 
principals 


15 

(8) 


22  25 

(11)  (10) 


26 

(13) 


36 

03) 


38  30 

(12)  (11) 


29  18 

(13)  (11) 


Shortage  of  29  35 

highly  quali-  (9)  (9) 

fied  teachers 


12  39 

(5)  (10) 


24  25 

(8)  (9) 


18  21 
(7)  (4) 


7  32  13  28  9  18 

(4)  (8)  (5)  (6)  (6)  (8) 


10  25  8  19 

(5)  (11) 


Shortage  of 
highly  quali¬ 
fied  math 
teachers 


40  76 

(12)  (10) 


69  66 

(13)  (14) 


33  28 


Shortage  of 
highly  quali¬ 
fied  science 
teachers 


43  60 

(13)  (11) 


69  78 

(13)  (12) 


28  39 


Shortage  of  38  23  22  28  31  24 

highly  quali-  (12)  (8)  (8)  (9)  (10)  (9) 

fied  teacher 
aides  and 
para-profes¬ 
sionals 


14  11  9  8 

(5)  (4)  (5)  (5) 


20  12  16  17 

(7)  (5)  (7)  (7) 


27  34  25  19 

(8)  (11) 


Teacher 

turnover 


22  19 

(10)  (7) 


20  12 

(9)  (6) 


19  10 

(9)  (7) 


19  20 

(6)  (6) 


15  25 

(6)  (9) 


19  24  2  33 

(7)  (7)  (1)  (14) 


13  21  9  18 

(5)  (10) 


Results  Tables  135 


Table  B.57 — Continued 


California,  %  (SE) 


Georgia,  %  (SE) 


Pennsylvania,  %  (SE) 


2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Hindrance 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

Shortage/ 

31 

34 

48 

32 

38 

47 

42 

44 

42 

25 

11 

26 

16 

17 

45 

16 

18 

30 

16 

51 

30 

22 

19 

39 

32 

49 

51 

lack  of 
high- 
quality  PD 
opportu¬ 
nities  for 
teachers 

(11) 

(13) 

(14) 

(10) 

(10) 

(13) 

(11) 

(10) 

(11) 

(7) 

(5) 

(11) 

(5) 

(6) 

(14) 

(6) 

(6) 

(12) 

(6) 

(13) 

(11) 

(9) 

Shortage/ 

44 

30 

39 

29 

39 

37 

29 

47 

40 

22 

12 

29 

10 

10 

45 

11 

12 

16 

16 

38 

42 

34 

22 

51 

36 

43 

52 

lack  of 

(15) 

(11) 

(13) 

(8) 

(10) 

(12) 

(11) 

(13) 

(12) 

(7) 

(5) 

(13) 

(5) 

(4) 

(14) 

(6) 

(5) 

(8) 

(6) 

(13) 

(12) 

(9) 

high- 
quality  PD 
opportu¬ 
nities  for 

principals 

Insufficient 

71 

72 

57 

69 

56 

43 

62 

65 

55 

63 

58 

38 

staff  time 
to  meet  ad¬ 
ministrative 

(7) 

(12) 

(9) 

(10) 

(6) 

(8) 

(7) 

(9) 

(10) 

responsi¬ 

bilities 

NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a  great  hindrance.  Percentages  represent  the  sum  of  the 
moderate  and  great  hindrance  responses.  "E"  is  elementary  principal,  "M"  is  middle  school  principal,  and  "S"  is  superintendent. 
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Table  B.58 

Teachers  Reporting  Inadequate  Time  as  a  Hindrance  to  Students'  Academic  Success 


California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 


Hindrance 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Insufficient  class 

71 

56 

70 

61 

75 

60 

58 

49 

59 

46 

58 

40 

58 

49 

64 

47 

64 

54 

time  to  cover  all  the 
curriculum 

(3) 

(4) 

(3) 

(5) 

(3) 

(4) 

(2) 

(4) 

(2) 

(2) 

(2) 

(3) 

(4) 

(3) 

(3) 

(6) 

(4) 

(4) 

Lack  of  teacher 

62 

43 

63 

37 

44 

38 

42 

32 

52 

29 

53 

30 

planning  time  built 

(3) 

(4) 

(4) 

(6) 

(3) 

(3) 

(4) 

(4) 

(3) 

(6) 

(4) 

(4) 

into  the  school  day3 

NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a  great  hindrance.  Percentages  represent  the  sum 
of  the  moderate  and  great  hindrance  responses. 

3  Blank  cells  indicate  that  we  did  not  ask  this  question  in  2004. 


Table  B.59 

Administrators  Reporting  Inadequate  Time  as  a  Moderate  or  Great  Hindrance  to  Their  Improvement  Efforts 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2004  2005  2006  2004  2005  2006  2004  2005  2006 

Hindrance  EMS  EMS  EMS  EMS  EMS  EMS  EMS  EMS  EMS 


Inadequate  57  56 

lead  time  (12)  (10) 
to  prepare 
before 
implement¬ 
ing  reforms 


92  46  31  85 
(5)  (9)  (10)  (7) 


36  38  58 

(9)  (10)  (11) 


67  41  86 
(9)  (8)  (7) 


34  36  69 

(7)  (10)  (13) 


43  40  32 
(8)  (9)  (10) 


52  47  64 

(10)  (12)  (12) 


34  33  57 

(7)  (12)  (15) 


22  64  73 


Lack  of 
teacher 
planning 
time  built 
into  the 
school  day 


71  36  56  40 

(9)  (10)  (6)  (12) 


44  22  39  17 

(6)  (7)  (8)  (6) 


41  12  37  20 

(8)  (8) 


NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a  great  hindrance.  Percentages  represent  the  sum  of  the 
moderate  and  great  hindrance  responses.  "E"  is  elementary  principal,  "M"  is  middle  school  principal,  and  "S"  is  superintendent. 
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Table  B.60 

Teachers  Reporting  Student  Background  Conditions  as  a  Hindrance  to  Students'  Academic  Success 


California,  %  (SE) 

Georgia, 

%  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Hindrance 

Elem 

Mid 

Elem 

Mid  1 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Inadequate  basic 

70 

79 

78 

83 

75 

84 

71 

85 

70 

86 

66 

83 

62 

81 

66 

85 

65 

83 

skills  or  prior 
preparation 

(6) 

(6) 

(5) 

(3) 

(3) 

(3) 

(5) 

(2) 

(4) 

(2) 

(4) 

(2) 

(5) 

(4) 

(5) 

(2) 

(4) 

(3) 

Lack  of  support  from 

68 

78 

75 

80 

72 

80 

74 

85 

75 

86 

73 

83 

72 

79 

69 

85 

72 

85 

parents 

(6) 

(6) 

(5) 

(4) 

(6) 

(4) 

(5) 

(2) 

(5) 

(2) 

(5) 

(2) 

(5) 

(4) 

(5) 

(2) 

(4) 

(3) 

Student  absenteeism 

51 

68 

61 

70 

64 

73 

54 

76 

51 

74 

47 

69 

52 

71 

51 

82 

51 

71 

and  tardiness 

(6) 

(6) 

(5) 

(4) 

(6) 

(5) 

(5) 

(3) 

(4) 

(2) 

(4) 

(2) 

(5) 

(3) 

(5) 

(5) 

(4) 

(4) 

Wide  range  of 

80 

68 

82 

77 

76 

77 

67 

69 

65 

71 

65 

69 

76 

72 

78 

75 

73 

72 

student  abilities  to 
address  in  class 

(4) 

(5) 

(3) 

(3) 

(4) 

(4) 

(3) 

(2) 

(3) 

(2) 

(3) 

(2) 

(3) 

(3) 

(3) 

(4) 

(3) 

(3) 

NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a  great  hindrance.  Percentages  represent  the  sum 
of  the  moderate  and  great  hindrance  responses. 
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Table  B.61 

Superintendents  Reporting  That  Their  Districts  Have  Sufficient  Staff  with  Necessary  Skills 
in  Certain  Areas 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania, 

%  (SE) 

Skill 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Facilitate  improvements  in 

61 

62 

79 

74 

67 

65 

80 

32 

44 

low-performing  schools 

(14) 

(14) 

(9) 

(12) 

(13) 

(12) 

(10) 

(15) 

(14) 

Help  schools  to  analyze  data 

70 

68 

74 

68 

66 

80 

86 

55 

31 

for  school  improvement 

(14) 

(12) 

(10) 

(13) 

(14) 

(10) 

(8) 

(16) 

(12) 

Help  schools  identify 

70 

57 

72 

71 

73 

77 

92 

58 

38 

research-based  strategies  for 
improvement 

(14) 

(12) 

(10) 

(12) 

(13) 

(11) 

(5) 

(16) 

(14) 

Conduct  PD  tailored  to  the 

52 

35 

57 

31 

68 

62 

73 

74 

34 

needs  of  teachers 

(14) 

(11) 

(11) 

(11) 

(14) 

(12) 

(11) 

(13) 

(13) 

Conduct  PD  tailored  to  the 

65 

27 

58 

34 

64 

68 

65 

48 

31 

needs  of  principals 

(14) 

(10) 

(11) 

(11) 

(14) 

(12) 

(12) 

(16) 

(12) 

Align  curriculum  with  state 

94 

52 

69 

63 

70 

70 

88 

85 

38 

content  standards  and  state 
assessments 

(5) 

(11) 

(10) 

(12) 

(13) 

(11) 

(8) 

(10) 

(13) 

NOTE:  Response  options  included  yes  and  no. 


Table  B.62 

Administrators  Reporting  Frequent  Changes  in  Policy  or  Leadership  as  a  Hindrance  to  Their  Improvement  Efforts 


California,  %  (SE) 

Georgia,  %  (SE) 

Pennsylvania,  %  (SE) 

2004 

2005 

2006 

2004 

2005 

2006 

2004 

2005 

2006 

Hindrance 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S 

E 

M 

S  E 

M 

S 

Frequent 

87 

71 

71 

76 

79 

67 

73 

98 

68 

changes 
in  state 

(8) 

(12) 

(11) 

(12) 

(12) 

(12) 

(11) 

(D 

(13) 

policy  or 
leadership 

Frequent 

22 

24 

46 

15 

37 

11 

21 

28 

11 

18 

15 

27 

21 

30 

19 

15 

19 

32 

changes 
in  district 

(7) 

(10) 

(10) 

(5) 

(12) 

(5) 

(7) 

(7) 

(4) 

(6) 

(4) 

(10) 

(6) 

(9) 

(7) 

(7) 

policy  and 
priorities 

Frequent 

12 

13 

30 

20 

29 

10 

18 

20 

14 

10 

11 

16 

9 

23 

14 

9 

13 

25 

changes 
in  district 
leadership 

(9) 

(11) 

(10) 

(8) 

(13) 

(6) 

(7) 

(7) 

(4) 

(4) 

(5) 

(7) 

(5) 

(9) 

(6) 

(7) 

Complvinq 

73 

71 

59 

0 

7 

12 

42 

51 

70 

with  teacher 
association 
rules/ 
policies 

(12) 

(12) 

(11) 

(NA) 

(6) 

(9) 

(12) 

Disagree- 

11 

2 

2 

13 

17 

33 

9 

21 

23 

ments  with 
district 
school 
board  over 
policies 

(8) 

(2) 

(2) 

(13) 

(9) 

(13) 

(9) 

NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a  great  hindrance.  Percentages  represent  the  sum  of  the 
moderate  and  great  hindrance  responses.  "E"  is  elementary  principal,  "M"  is  middle  school  principal,  and  "S"  is  superintendent. 
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Table  B.63 

Principals  Reporting  Lack  of  Guidance  for  Teaching  Standards  to  Students  Subgroups  as  a 
Hindrance  to  Their  School  Improvement  Efforts 

California,  %  (SE)  Georgia,  %  (SE)  Pennsylvania,  %  (SE) 

2005  2006  2005  2006  2005  2006 


Hindrance 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Elem 

Mid 

Lack  of  guidance  for 

51 

26 

39 

37 

17 

21 

28 

39 

27 

41 

23 

21 

teaching  grade-level 
standards  to  special 
education  students) 

(10) 

(9) 

(9) 

(9) 

(6) 

(8) 

(8) 

(10) 

(8) 

(14) 

(7) 

(9) 

Lack  of  guidance  for 

47 

15 

49 

45 

19 

21 

22 

30 

27 

8 

18 

20 

teaching  grade-level 
standards  to  ELLs 

(10) 

(7) 

(10) 

(11) 

(7) 

(6) 

(9) 

(7) 

(8) 

(3) 

(5) 

(7) 

NOTES:  Response  options  included  not  a  hindrance,  a  minor  hindrance,  a  moderate  hindrance,  and  a 
great  hindrance.  Percentages  represent  the  sum  of  the  moderate  and  great  hindrance  responses. 
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